-- Logs begin at Fri 2022-07-15 15:53:20 UTC, end at Fri 2022-07-15 16:51:21 UTC. -- Jul 15 16:23:47.712276 dv-osbrick-836059-6-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 15 16:23:47.721335 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 15 16:23:47.723365 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 16:23:47 2022] *** Jul 15 16:23:47.723365 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 16:23:47.723365 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 16:23:47.723365 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: nodename: dv-osbrick-836059-6-ceph Jul 15 16:23:47.723365 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: machine: x86_64 Jul 15 16:23:47.723365 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: clock source: unix Jul 15 16:23:47.723365 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: pcre jit disabled Jul 15 16:23:47.723365 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: detected number of CPU cores: 4 Jul 15 16:23:47.723365 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: current working directory: / Jul 15 16:23:47.723365 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: detected binary path: /usr/bin/uwsgi-core Jul 15 16:23:47.723365 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: your processes number limit is 47680 Jul 15 16:23:47.723365 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: your memory page size is 4096 bytes Jul 15 16:23:47.724145 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: detected max file descriptor number: 2048 Jul 15 16:23:47.724145 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: lock engine: pthread robust mutexes Jul 15 16:23:47.724145 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: thunder lock: enabled Jul 15 16:23:47.724145 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 15 16:23:47.724145 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 16:23:47.769429 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: Python main interpreter initialized at 0x55c3fa1a59c0 Jul 15 16:23:47.769429 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: python threads support enabled Jul 15 16:23:47.769429 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: your server socket listen backlog is limited to 100 connections Jul 15 16:23:47.769429 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: your mercy for graceful operations on workers is 90 seconds Jul 15 16:23:47.769812 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 16:23:47.769890 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: *** Operational MODE: preforking *** Jul 15 16:23:47.770103 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: *** uWSGI is running in multiple interpreter mode *** Jul 15 16:23:47.770103 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: spawned uWSGI master process (pid: 87089) Jul 15 16:23:47.770310 dv-osbrick-836059-6-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 15 16:23:47.771125 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: spawned uWSGI worker 1 (pid: 87099, cores: 1) Jul 15 16:23:47.771223 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: spawned uWSGI worker 2 (pid: 87100, cores: 1) Jul 15 16:23:47.771508 dv-osbrick-836059-6-ceph devstack@keystone.service[87089]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 16:23:53.458161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 16:23:53.458161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: from cryptography.utils import int_from_bytes Jul 15 16:23:53.458982 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 16:23:53.458982 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: from cryptography.utils import int_from_bytes Jul 15 16:23:53.461092 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 16:23:53.461092 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: from cryptography.utils import int_from_bytes Jul 15 16:23:53.461532 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 16:23:53.461532 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: from cryptography.utils import int_from_bytes Jul 15 16:23:53.507865 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 16:23:53.508066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 16:23:53.508169 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 16:23:53.508264 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] command line args: [] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 16:23:53.508371 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 16:23:53.508524 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 16:23:53.508602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] command line args: [] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 16:23:53.508707 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ================================================================================ {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 16:23:53.508822 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 16:23:53.508974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] admin_token = **** {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.509050 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ================================================================================ {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 16:23:53.509225 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] config_dir = [] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.509302 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] admin_token = **** {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.509419 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.509501 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] config_dir = [] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.509607 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] config_source = [] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.509683 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.509802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] debug = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.509885 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] config_source = [] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.509978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] debug = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.510053 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.510304 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.510431 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.510528 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.510627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.510721 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.510835 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.510974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.511072 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.511172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.511273 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] list_limit = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.511373 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] list_limit = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.511474 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] log_config_append = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.511568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] log_config_append = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.511666 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.511766 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.511858 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] log_dir = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.511955 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] log_dir = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.512061 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] log_file = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.512162 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] log_file = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.512261 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.512370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.512490 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.512609 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.512729 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.512848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.512966 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.513075 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.513187 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.513307 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.513430 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.513553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.513673 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.513787 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.513906 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.514028 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.514134 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.514249 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.514368 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.514486 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.514604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.514728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.514841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.514977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.515213 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.515848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.515958 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.516081 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.516196 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.516316 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.516429 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.86/identity {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.516542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.86/identity {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.516662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] publish_errors = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.516780 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] publish_errors = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.516897 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.517021 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.517140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.517253 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.517364 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.517471 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.517587 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.517720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.517841 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.517959 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.518072 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] standard_threads = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.518183 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] standard_threads = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.518361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.518482 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.518600 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.518712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.518820 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.518937 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.519050 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] use_journal = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.519157 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] use_journal = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.519251 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] use_json = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.519351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] use_json = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.519463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] use_stderr = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.519583 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] use_stderr = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.519701 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] use_syslog = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.519813 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] use_syslog = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.519925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.520035 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 16:23:53.520146 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.520271 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.520391 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.520502 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.520603 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.520709 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.520804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.520908 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.521008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.521102 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.521195 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.521287 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.521380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.521481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.521576 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.521686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.521797 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.521908 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.522020 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.522143 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.522257 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.522368 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.522480 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.522597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.522722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.522844 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.522971 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.523097 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.523211 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.523328 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.523441 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.523630 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.523751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.523871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.523989 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.524102 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.524219 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.524339 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.524452 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.524564 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.524682 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.524800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.524913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.525035 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.525148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.525265 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.525384 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.525501 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.525614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.525737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.525851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.525969 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.526082 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.526199 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.526312 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.526432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.526545 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.526656 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.526768 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.526900 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.527026 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.527140 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.527252 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.527363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.527474 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.527585 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.527705 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.527819 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.527931 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.528048 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.528161 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.528272 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.528396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.528396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.528612 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.528730 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.528844 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.528955 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.529145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.529265 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.529378 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.529496 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.529608 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.529719 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.529843 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.529956 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.530073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.530186 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.530305 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.530422 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.530542 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.530665 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.530778 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.530913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.531028 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.531146 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.531270 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.531383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.531495 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.531606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.531717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.531834 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.531956 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.532070 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.532181 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.532298 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.532412 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.532554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.532554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.532788 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.532902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.533015 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.533167 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.533281 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.533406 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.533526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.533645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.533759 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.533878 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.533991 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.534114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.534236 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.534351 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.534474 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.534596 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.534711 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.534830 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.535008 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.535132 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.535254 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.535369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.535482 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.535595 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.535707 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.535829 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.535944 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.536092 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.536209 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.536329 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.536442 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.536564 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.536684 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.536803 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.536917 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.537030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.537151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.537266 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.537379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.537491 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.537604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.537713 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.537818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.537931 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.538043 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.538155 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.538269 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.538381 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.538502 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.538653 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.538768 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.538918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.538918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.539136 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.539262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.539377 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.539377 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.539595 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.539699 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.539812 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.539932 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.540046 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.540159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.540271 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.540271 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.540483 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.540671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.540787 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.540900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.541012 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.541125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.541249 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.541373 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.541497 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.541624 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.541738 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.541851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.541964 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.542076 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.542187 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.542308 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.542424 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.542537 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.542649 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.542762 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.542888 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.543015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.543136 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.543251 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.543363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.543489 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.543603 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.543603 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.543825 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.543938 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.544057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.544057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] auth.external = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.544270 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.544392 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.544507 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.544507 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.544718 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.544832 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] auth.external = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.544952 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.545098 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.545223 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] auth.password = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.545223 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] auth.token = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.545438 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.545554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.545667 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.545780 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.545905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] auth.password = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.546026 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.546147 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] auth.token = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.546262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.546375 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.546498 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.546622 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.546737 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.546850 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.547030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.547143 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.547268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] credential.caching = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.547392 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.547507 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.547621 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.547736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.547850 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.547963 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.548085 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] credential.caching = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.548212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.548328 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.548442 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.548555 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.548669 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.548792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.548907 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.549021 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.549139 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.549259 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.549375 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.549497 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.549612 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.549732 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.549848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.549962 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.550076 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.550197 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.550312 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.550426 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.550539 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.550652 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.550765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.550910 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.551028 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] federation.caching = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.551142 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.551256 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.551377 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.551493 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.551615 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.551731 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.551846 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] federation.caching = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.551960 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.552074 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.552194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.552194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.552420 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.552420 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.552634 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.552748 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.552862 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.552984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.553100 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.553214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.553328 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.553441 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.553555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.553676 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.553792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity.caching = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.553792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.554011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.554011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.554227 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.554227 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.554514 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.554628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.554742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity.caching = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.554855 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.555001 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.555117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.555232 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.555346 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.555459 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.555573 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.555695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.555811 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.555924 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.556038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.556152 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.556266 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.556388 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.556504 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.556624 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.556740 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.556853 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.556967 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.557156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.557272 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.557386 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.557499 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.557613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.557727 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.557849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.557965 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.558078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.558194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.558307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.558422 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.558544 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.558659 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.558773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.558906 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.559023 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.559224 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.559351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.559467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.559581 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.559695 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.559809 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.559923 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.560045 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.560160 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.560275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.560389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.560503 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.560616 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.560741 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.560856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.560970 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.561084 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.561197 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.561312 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.561443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.561564 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.561679 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.561793 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.561906 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.562588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.562712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.562828 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.562974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.563087 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.563200 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.563314 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.563442 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.563558 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.563680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.563796 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.563910 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.564023 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.564145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.564260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.564260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.564475 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.564589 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.564702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.564824 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.564939 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.565053 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.565166 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.565280 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.565400 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.565525 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.565641 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.565755 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.565869 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.565983 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.566096 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.566219 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.566335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.566449 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.566564 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.566678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.566792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.566940 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.567058 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.567172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.567285 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.567399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.567521 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.567637 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.567751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.567865 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.567977 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.568091 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.568213 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.568328 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.568442 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.568555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.568670 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.568784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.568905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.569024 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.569139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.569253 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.569375 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.569490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.569612 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.569734 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.569849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.569963 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.570076 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.570190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.570315 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.570430 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.570544 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.570658 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.570772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.570931 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.571061 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.571177 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.571292 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.571405 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.571519 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.571633 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.571756 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.571872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.571986 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.572099 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.572212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.572326 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.572447 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.572563 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.572676 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.572789 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.572903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.573017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.573138 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.573254 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.573367 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.573481 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.573594 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.573708 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.573829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.573946 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.574060 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.574174 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.574287 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.574400 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.574526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.574642 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.574756 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.574889 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] resource.caching = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.575006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.575120 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.575246 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.575362 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.575475 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.575595 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.575710 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.575824 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.575946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.576062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.576175 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] resource.caching = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.576552 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.576666 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.576780 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.576902 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.577019 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.577133 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.577246 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.577360 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.577474 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] role.caching = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.578260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.578416 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] role.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.578532 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.578647 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.578760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.578945 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.579077 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.579199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.579314 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.579428 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.579541 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] role.caching = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.579661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.579765 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] role.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.579928 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.580118 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.580307 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.580489 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.580489 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.580724 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.580841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.580955 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.581055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.581055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.581263 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.581378 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.581492 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.581605 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.581605 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.581817 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.581939 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.582053 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.582167 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.582167 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.582381 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.582501 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.582501 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.582727 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.582841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.582976 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.583090 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.583204 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.583332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.583332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.583549 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.583662 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.583776 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.583890 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.584012 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.584127 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.584241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.584356 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.584469 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.584583 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.584705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.584821 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.584934 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.585048 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.585161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.585275 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.585397 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.585513 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.585627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.585740 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.585853 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.585975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.586090 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.586203 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.586317 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.586431 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.586570 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.586698 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.586813 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.586957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.587107 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] token.caching = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.587223 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.587337 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.587464 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] token.caching = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.587582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.587696 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.587809 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.587923 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.588036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.588162 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.588277 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.588381 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.588477 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.588572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.588724 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.588851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.588967 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.589081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.589198 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.589312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.589426 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.589547 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.589664 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.589778 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.589891 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.590004 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.590118 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.590239 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.590354 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.590468 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.590582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.590695 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.590808 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.590974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.591091 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.591205 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.591357 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.591475 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.connection = **** {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.591622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.connection = **** {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.591756 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.591880 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.591996 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.592118 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.592233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.592347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.592460 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.592574 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.592688 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.592811 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.592926 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.593040 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.593181 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.593300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.593412 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.593535 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.593650 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.593792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.593907 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.594020 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.594156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.594282 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.594397 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.594510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.594646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.594762 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.594906 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.595035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.595151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.595264 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.595378 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.595490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.595603 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.595725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.595840 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.595955 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 16:23:53.596068 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 16:23:53.596182 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 16:23:53.626605 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.626828 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.627076 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.627228 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.627466 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.627696 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.636212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.638550 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.664789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.665021 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.666420 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.666655 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.718072 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.718301 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.769315 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.769544 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.770299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.770541 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.834502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.834731 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.834986 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.835077 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.835211 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.835299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.835431 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.835517 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.835649 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.835744 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.835919 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.836139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.858383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.858670 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.859395 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.859478 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.859623 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.859700 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.859844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.859942 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.860070 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.860150 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.860283 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.860453 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.860680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.860899 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.871832 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.873332 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.885740 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.885985 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.886194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.886283 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.886430 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.886513 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.886661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.886743 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.886899 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.886983 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.887120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.887202 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.887334 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.887552 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 16:23:53.905393 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.905606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 16:23:53.905690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.905849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 16:23:53.905967 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.906166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 16:23:53.906245 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.906376 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 16:23:53.906458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.906648 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.906729 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.906942 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.907113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.907265 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.907417 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.907554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.918079 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.918224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.918355 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.918498 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.918627 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.918931 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.919019 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.919224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.927538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:53.927969 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:53.930801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:53.931104 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.931392 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.931483 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:53.931667 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.931754 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.931946 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.932035 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.932203 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.932289 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.932494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.932578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.932757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.932841 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.933026 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.933120 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.933304 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.933396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.933574 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.933661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.933847 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.934216 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.960632 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.961664 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.962348 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:53.962628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.963304 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:53.963585 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.967910 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:53.968263 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.968504 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.969162 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:53.969444 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.969724 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.975768 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:53.976048 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.977028 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:53.977312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.980516 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:53.980913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.981199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.981485 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.981762 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.981843 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:53.982039 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.982119 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.982311 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.982400 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.982582 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.982663 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.982897 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.983163 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.983545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:53.984484 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.002227 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.002502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.003858 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.004268 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.007185 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.009117 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.010816 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.011136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.012781 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.013077 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.016146 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.018206 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.019730 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.021825 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.023489 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.023794 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.024088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.024366 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.024639 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.024921 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.025533 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.025834 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.026123 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.026407 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.026686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.027261 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.045318 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.045620 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.045887 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.046151 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.049499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.049797 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.050069 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.050335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.054722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.056479 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.056758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.058342 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.059797 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.060076 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.060177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.060369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.060452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.060653 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.060951 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.064303 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.064591 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.064874 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.065166 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.065456 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.074765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.075076 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.075359 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.075641 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.075921 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.076451 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.076746 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.079100 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.079379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.079662 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.079945 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.080229 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.080503 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.080776 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.094754 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.098016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.098941 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.101341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.102337 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.102966 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.104599 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.104879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.105161 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.105680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.107323 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.109478 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.109756 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.110039 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.113069 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.114683 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.117360 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.117910 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.118199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.118482 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.118758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.119130 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.122347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.122641 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.122948 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.123225 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.128375 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.128662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.129953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.133045 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.133336 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.133621 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.138058 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.138337 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.138618 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.138912 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.139194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.139462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.139739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.140033 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.140303 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.140570 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.140851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.141119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.141390 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.141655 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.141931 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 16:23:54.142210 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.142492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.142768 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.143080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.143366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.143648 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.143915 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.144194 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.144472 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.144756 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.145018 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.145281 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.145548 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 16:23:54.180271 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c3fa1a59c0 pid: 87100 (default app) Jul 15 16:23:54.183492 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63c708-4cc2-41b0-8222-75e20e502a3b None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:23:54.183790 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63c708-4cc2-41b0-8222-75e20e502a3b None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:23:54.184070 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63c708-4cc2-41b0-8222-75e20e502a3b None None] PATH_INFO: `/v3` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:23:54.185533 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c3fa1a59c0 pid: 87099 (default app) Jul 15 16:23:54.188400 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 1/1] 10.222.0.86 () {50 vars in 791 bytes} [Fri Jul 15 16:23:54 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:02.157780 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46ce2-3da6-4b4b-8dab-e7e677eecb55 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:02.158333 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46ce2-3da6-4b4b-8dab-e7e677eecb55 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:02.158333 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46ce2-3da6-4b4b-8dab-e7e677eecb55 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:02.162732 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 1/2] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:02.167895 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31a5ce-4dc7-4c98-a734-4e7a6a367075 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:02.168326 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31a5ce-4dc7-4c98-a734-4e7a6a367075 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:02.168461 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31a5ce-4dc7-4c98-a734-4e7a6a367075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:02.241431 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: INFO dbcounter [None req-bc31a5ce-4dc7-4c98-a734-4e7a6a367075 None None] Registered counter for database keystone Jul 15 16:24:02.262123 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG oslo_db.sqlalchemy.engines [None req-bc31a5ce-4dc7-4c98-a734-4e7a6a367075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 16:24:02.268875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writer thread running {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 16:24:02.445056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG passlib.handlers.bcrypt [None req-bc31a5ce-4dc7-4c98-a734-4e7a6a367075 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87100) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 16:24:02.445482 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG passlib.handlers.bcrypt [None req-bc31a5ce-4dc7-4c98-a734-4e7a6a367075 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87100) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 16:24:02.500521 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-bc31a5ce-4dc7-4c98-a734-4e7a6a367075 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:02.502117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-bc31a5ce-4dc7-4c98-a734-4e7a6a367075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:02.623379 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 2/3] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 16:24:02.776703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46ce2-3da6-4b4b-8dab-e7e677eecb55 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:02.852013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: INFO dbcounter [None req-a3e46ce2-3da6-4b4b-8dab-e7e677eecb55 None None] Registered counter for database keystone Jul 15 16:24:02.871998 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG oslo_db.sqlalchemy.engines [None req-a3e46ce2-3da6-4b4b-8dab-e7e677eecb55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 16:24:02.878706 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writer thread running {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 16:24:02.996276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46ce2-3da6-4b4b-8dab-e7e677eecb55 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:03.001251 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44539f29-fab7-4eed-9700-e152e0660c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:03.001787 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44539f29-fab7-4eed-9700-e152e0660c61 admin admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:03.002073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44539f29-fab7-4eed-9700-e152e0660c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:03.002351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44539f29-fab7-4eed-9700-e152e0660c61 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:03.010478 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44539f29-fab7-4eed-9700-e152e0660c61 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:03.061195 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: WARNING keystone.common.rbac_enforcer.enforcer [None req-44539f29-fab7-4eed-9700-e152e0660c61 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 16:24:03.061489 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44539f29-fab7-4eed-9700-e152e0660c61 admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:03.071618 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 2/4] 10.222.0.86 () {58 vars in 1324 bytes} [Fri Jul 15 16:24:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 16:24:03.078323 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31a5ce-4dc7-4c98-a734-4e7a6a367075 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:03.092926 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31a5ce-4dc7-4c98-a734-4e7a6a367075 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:03.097830 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8356aed-09aa-4e6a-b342-6922cb2df4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:03.098978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8356aed-09aa-4e6a-b342-6922cb2df4da admin admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:03.099266 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8356aed-09aa-4e6a-b342-6922cb2df4da admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:03.099550 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8356aed-09aa-4e6a-b342-6922cb2df4da admin admin] PATH_INFO: `/v3/projects/fcb5a6ba5f5c46348953f622f9e98380` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:03.101144 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8356aed-09aa-4e6a-b342-6922cb2df4da admin admin] RBAC: Authorizing `identity:get_project(project_id=fcb5a6ba5f5c46348953f622f9e98380)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:03.153557 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c8356aed-09aa-4e6a-b342-6922cb2df4da admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 16:24:03.153902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8356aed-09aa-4e6a-b342-6922cb2df4da admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:03.158608 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 3/5] 10.222.0.86 () {56 vars in 1207 bytes} [Fri Jul 15 16:24:03 2022] GET /identity/v3/projects/fcb5a6ba5f5c46348953f622f9e98380 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:05.344819 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f304b-0cbc-402c-bf8e-aba1a8b43400 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:05.345363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f304b-0cbc-402c-bf8e-aba1a8b43400 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:05.345514 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f304b-0cbc-402c-bf8e-aba1a8b43400 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:05.349661 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 3/6] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:05.355113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6a406-d570-448f-a4e6-cecfe94bff6d None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:05.355498 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6a406-d570-448f-a4e6-cecfe94bff6d None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:05.355668 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6a406-d570-448f-a4e6-cecfe94bff6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:05.373932 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-d1e6a406-d570-448f-a4e6-cecfe94bff6d None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:05.376026 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-d1e6a406-d570-448f-a4e6-cecfe94bff6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:05.383779 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 4/7] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 16:24:05.407820 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f304b-0cbc-402c-bf8e-aba1a8b43400 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:05.419838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f304b-0cbc-402c-bf8e-aba1a8b43400 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:05.424183 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76e179-6d9d-4420-aa3f-3416062114cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:05.424815 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76e179-6d9d-4420-aa3f-3416062114cc admin admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:05.425103 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76e179-6d9d-4420-aa3f-3416062114cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:05.425385 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76e179-6d9d-4420-aa3f-3416062114cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:05.433174 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76e179-6d9d-4420-aa3f-3416062114cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:05.434970 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76e179-6d9d-4420-aa3f-3416062114cc admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:05.444210 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 4/8] 10.222.0.86 () {58 vars in 1324 bytes} [Fri Jul 15 16:24:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 16:24:05.449279 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6a406-d570-448f-a4e6-cecfe94bff6d None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:05.458953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6a406-d570-448f-a4e6-cecfe94bff6d None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:05.463249 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51805ff-2c7c-4881-a175-12c6a02b6841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:05.464094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51805ff-2c7c-4881-a175-12c6a02b6841 admin admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:05.464379 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51805ff-2c7c-4881-a175-12c6a02b6841 admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:05.464654 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51805ff-2c7c-4881-a175-12c6a02b6841 admin admin] PATH_INFO: `/v3/users/44293b77272f4265bf2e4dd85cca6be9` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:05.466017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51805ff-2c7c-4881-a175-12c6a02b6841 admin admin] RBAC: Authorizing `identity:get_user(user_id=44293b77272f4265bf2e4dd85cca6be9)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:05.467863 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51805ff-2c7c-4881-a175-12c6a02b6841 admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:05.470144 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 5/9] 10.222.0.86 () {56 vars in 1198 bytes} [Fri Jul 15 16:24:05 2022] GET /identity/v3/users/44293b77272f4265bf2e4dd85cca6be9 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:07.738487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c3386-ad28-4d35-ac6e-c65ea4b0f309 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:07.739065 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c3386-ad28-4d35-ac6e-c65ea4b0f309 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:07.739065 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c3386-ad28-4d35-ac6e-c65ea4b0f309 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:07.740442 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 5/10] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:07.745810 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bcae9-1f00-4b5f-b68b-1ed10f857e57 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:07.746214 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bcae9-1f00-4b5f-b68b-1ed10f857e57 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:07.746384 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bcae9-1f00-4b5f-b68b-1ed10f857e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:07.762753 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-1e0bcae9-1f00-4b5f-b68b-1ed10f857e57 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:07.763974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-1e0bcae9-1f00-4b5f-b68b-1ed10f857e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:07.785770 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bbf01-8bbf-46e9-8207-3b284db834f7 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:07.786068 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bbf01-8bbf-46e9-8207-3b284db834f7 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:07.786357 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bbf01-8bbf-46e9-8207-3b284db834f7 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:07.787730 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 6/11] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:24:07.792675 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae41322-06c6-4a0a-b615-e5bef1ae480f None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:07.792969 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae41322-06c6-4a0a-b615-e5bef1ae480f None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:07.793250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae41322-06c6-4a0a-b615-e5bef1ae480f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:07.832914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG passlib.handlers.bcrypt [None req-6ae41322-06c6-4a0a-b615-e5bef1ae480f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87099) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 16:24:07.833349 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG passlib.handlers.bcrypt [None req-6ae41322-06c6-4a0a-b615-e5bef1ae480f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87099) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 16:24:07.845083 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 6/12] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:07.869072 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bcae9-1f00-4b5f-b68b-1ed10f857e57 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:07.879684 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-6ae41322-06c6-4a0a-b615-e5bef1ae480f None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:07.881304 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-6ae41322-06c6-4a0a-b615-e5bef1ae480f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:07.892414 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:07.987541 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 7/13] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:08.010682 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae41322-06c6-4a0a-b615-e5bef1ae480f None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:08.084406 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bcae9-1f00-4b5f-b68b-1ed10f857e57 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:08.114189 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae41322-06c6-4a0a-b615-e5bef1ae480f None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:08.116533 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:08.117835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8f781-01c4-4a07-9a23-04af13cb116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:08.118704 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8f781-01c4-4a07-9a23-04af13cb116a None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:08.119089 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8f781-01c4-4a07-9a23-04af13cb116a None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:08.119373 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8f781-01c4-4a07-9a23-04af13cb116a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:08.130403 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8f781-01c4-4a07-9a23-04af13cb116a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-aaa8f781-01c4-4a07-9a23-04af13cb116a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:08.143035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:08.144038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:08.144844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:08.144844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:08.144844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:08.144844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:08.144844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:08.144844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:08.144844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:08.144844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:08.144844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:08.144844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:08.144844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:08.144844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:08.144844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 7/14] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:24:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:24:08.150009 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8f781-01c4-4a07-9a23-04af13cb116a None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:08.153606 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39e58b-3831-4d9d-8ded-ff768dfea745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:08.154512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39e58b-3831-4d9d-8ded-ff768dfea745 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:08.154799 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39e58b-3831-4d9d-8ded-ff768dfea745 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:08.155114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39e58b-3831-4d9d-8ded-ff768dfea745 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:08.224096 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39e58b-3831-4d9d-8ded-ff768dfea745 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:08.225602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39e58b-3831-4d9d-8ded-ff768dfea745 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:08.230195 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:08.248549 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8f781-01c4-4a07-9a23-04af13cb116a None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:08.282020 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d5128-9216-4e92-ab67-f6068f8e5118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:08.282605 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d5128-9216-4e92-ab67-f6068f8e5118 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:08.282915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d5128-9216-4e92-ab67-f6068f8e5118 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:08.283193 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d5128-9216-4e92-ab67-f6068f8e5118 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:08.283936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d5128-9216-4e92-ab67-f6068f8e5118 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:08.284243 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d5128-9216-4e92-ab67-f6068f8e5118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:08.285620 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d5128-9216-4e92-ab67-f6068f8e5118 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:08.297281 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 8/15] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:08.302761 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d5128-9216-4e92-ab67-f6068f8e5118 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:08.321928 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 8/16] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 16:24:08.328210 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39e58b-3831-4d9d-8ded-ff768dfea745 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:08.331277 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:08.400846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d5128-9216-4e92-ab67-f6068f8e5118 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:08.424157 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39e58b-3831-4d9d-8ded-ff768dfea745 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:08.441124 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb78c0-19c9-4f0b-beb7-92eeb56481c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:08.441990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb78c0-19c9-4f0b-beb7-92eeb56481c7 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:08.442277 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb78c0-19c9-4f0b-beb7-92eeb56481c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:08.442552 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb78c0-19c9-4f0b-beb7-92eeb56481c7 None admin] PATH_INFO: `/v3/users/44293b77272f4265bf2e4dd85cca6be9` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:08.443798 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb78c0-19c9-4f0b-beb7-92eeb56481c7 None admin] RBAC: Authorizing `identity:get_user(user_id=44293b77272f4265bf2e4dd85cca6be9)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:08.445265 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb78c0-19c9-4f0b-beb7-92eeb56481c7 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:08.447062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 9/17] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:08 2022] GET /identity/v3/users/44293b77272f4265bf2e4dd85cca6be9 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:08.452999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb78c0-19c9-4f0b-beb7-92eeb56481c7 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:08.458598 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8313c06-cfbd-42ba-8fcf-7d6ed3864933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:08.459427 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8313c06-cfbd-42ba-8fcf-7d6ed3864933 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:08.459715 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8313c06-cfbd-42ba-8fcf-7d6ed3864933 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:08.459990 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8313c06-cfbd-42ba-8fcf-7d6ed3864933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:08.467048 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:08.478431 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8313c06-cfbd-42ba-8fcf-7d6ed3864933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:08.479924 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8313c06-cfbd-42ba-8fcf-7d6ed3864933 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:08.500980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-d8313c06-cfbd-42ba-8fcf-7d6ed3864933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:24:08.500980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:08.500980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:08.500980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:08.500980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:08.500980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:08.500980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:08.500980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:08.500980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:08.500980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:08.500980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:08.500980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:08.500980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:24:08.500980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:24:08.500980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:08.501792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:08.502757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:24:08.502757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:24:08.502757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:24:08.502757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:08.502757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 9/18] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:24:08.507868 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8313c06-cfbd-42ba-8fcf-7d6ed3864933 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:08.553161 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb78c0-19c9-4f0b-beb7-92eeb56481c7 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:08.562944 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:08.586670 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2345fd6-8a72-4fa3-92cf-05886f4ca6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:08.587492 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2345fd6-8a72-4fa3-92cf-05886f4ca6ea None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:08.587779 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2345fd6-8a72-4fa3-92cf-05886f4ca6ea None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:08.588057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2345fd6-8a72-4fa3-92cf-05886f4ca6ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:08.589244 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2345fd6-8a72-4fa3-92cf-05886f4ca6ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:08.590688 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2345fd6-8a72-4fa3-92cf-05886f4ca6ea None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:08.592321 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 10/19] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:08.598450 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2345fd6-8a72-4fa3-92cf-05886f4ca6ea None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:08.607758 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8313c06-cfbd-42ba-8fcf-7d6ed3864933 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:08.641473 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05e30b-a782-418a-81f7-a71bd2d38314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:08.642089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05e30b-a782-418a-81f7-a71bd2d38314 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:08.642372 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05e30b-a782-418a-81f7-a71bd2d38314 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:08.642652 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05e30b-a782-418a-81f7-a71bd2d38314 None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:08.643420 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05e30b-a782-418a-81f7-a71bd2d38314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:08.643731 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05e30b-a782-418a-81f7-a71bd2d38314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:08.645116 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05e30b-a782-418a-81f7-a71bd2d38314 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:08.680554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:08.701516 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2345fd6-8a72-4fa3-92cf-05886f4ca6ea None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:08.739748 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1ca3b-0825-48dc-b37e-9f2e586aec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:08.740421 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1ca3b-0825-48dc-b37e-9f2e586aec2f None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:08.740731 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1ca3b-0825-48dc-b37e-9f2e586aec2f None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:08.741005 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1ca3b-0825-48dc-b37e-9f2e586aec2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:08.741851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1ca3b-0825-48dc-b37e-9f2e586aec2f None admin] RBAC: Adding query filter params (role.id=923dd61feaca45d0933a4601fb2c065b, scope.domain.id=default, user.id=44293b77272f4265bf2e4dd85cca6be9) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:08.742163 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1ca3b-0825-48dc-b37e-9f2e586aec2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:08.743688 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1ca3b-0825-48dc-b37e-9f2e586aec2f None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:08.751224 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 11/20] 10.222.0.86 () {56 vars in 1322 bytes} [Fri Jul 15 16:24:08 2022] GET /identity/v3/role_assignments?user.id=44293b77272f4265bf2e4dd85cca6be9&scope.domain.id=default&role.id=923dd61feaca45d0933a4601fb2c065b => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:08.772975 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 10/21] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:11.316119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07684d4a-7842-472c-887d-182464043369 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:11.316730 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07684d4a-7842-472c-887d-182464043369 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:11.316730 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07684d4a-7842-472c-887d-182464043369 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:11.318041 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 12/22] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:11.332371 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213aed7-a846-4e79-8964-7ceb5388e668 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:11.332786 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213aed7-a846-4e79-8964-7ceb5388e668 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:11.332947 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213aed7-a846-4e79-8964-7ceb5388e668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:11.360107 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-6213aed7-a846-4e79-8964-7ceb5388e668 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:11.361339 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-6213aed7-a846-4e79-8964-7ceb5388e668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:11.434015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff1a1f-ae34-405e-b041-0e33b5f66d35 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:11.434345 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff1a1f-ae34-405e-b041-0e33b5f66d35 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:11.434582 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff1a1f-ae34-405e-b041-0e33b5f66d35 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:11.436108 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 13/23] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:11.443160 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7f26f-560d-4973-9cbd-91939ec46ef6 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:11.443455 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7f26f-560d-4973-9cbd-91939ec46ef6 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:11.443741 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7f26f-560d-4973-9cbd-91939ec46ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:11.470536 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-c2e7f26f-560d-4973-9cbd-91939ec46ef6 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:11.472047 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-c2e7f26f-560d-4973-9cbd-91939ec46ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:11.485874 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 11/24] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:11.567118 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213aed7-a846-4e79-8964-7ceb5388e668 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:11.580901 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 14/25] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:11.625525 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7f26f-560d-4973-9cbd-91939ec46ef6 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:11.662755 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:11.748258 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213aed7-a846-4e79-8964-7ceb5388e668 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:11.803651 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:11.813389 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2cec1-b1f5-4166-9300-216e06ca68f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:11.815077 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2cec1-b1f5-4166-9300-216e06ca68f5 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:11.817320 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2cec1-b1f5-4166-9300-216e06ca68f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:11.817320 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2cec1-b1f5-4166-9300-216e06ca68f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:11.835561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2cec1-b1f5-4166-9300-216e06ca68f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-afa2cec1-b1f5-4166-9300-216e06ca68f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:11.848692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:11.849793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:11.850737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:11.850737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:11.850737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:11.850737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:11.850737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:11.850737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:11.850737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:11.850737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:11.850737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:11.850737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:11.850737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:11.850737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:11.857683 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7f26f-560d-4973-9cbd-91939ec46ef6 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:11.860296 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 12/26] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:24:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:24:11.878215 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2cec1-b1f5-4166-9300-216e06ca68f5 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:11.904665 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67285364-f583-4101-bb8c-17922df0f3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:11.905650 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67285364-f583-4101-bb8c-17922df0f3b6 None admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:11.907418 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67285364-f583-4101-bb8c-17922df0f3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:11.907847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67285364-f583-4101-bb8c-17922df0f3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:11.908756 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67285364-f583-4101-bb8c-17922df0f3b6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:11.911694 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67285364-f583-4101-bb8c-17922df0f3b6 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:12.078125 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2cec1-b1f5-4166-9300-216e06ca68f5 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:12.114240 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdee2f2-3bec-46f1-bee5-75355f2148db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:12.115217 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdee2f2-3bec-46f1-bee5-75355f2148db None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:12.115659 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdee2f2-3bec-46f1-bee5-75355f2148db None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:12.116261 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdee2f2-3bec-46f1-bee5-75355f2148db None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:12.117161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdee2f2-3bec-46f1-bee5-75355f2148db None admin] RBAC: Adding query filter params (name=admin) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:12.117624 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdee2f2-3bec-46f1-bee5-75355f2148db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:12.119194 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdee2f2-3bec-46f1-bee5-75355f2148db None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:12.123077 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:12.132935 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 13/27] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:12.134675 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc17a3-9d81-4e74-91da-6ed653af9e50 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:12.135154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc17a3-9d81-4e74-91da-6ed653af9e50 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:12.135873 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc17a3-9d81-4e74-91da-6ed653af9e50 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:12.137356 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 14/28] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:12.138264 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc17a3-9d81-4e74-91da-6ed653af9e50 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:12.175383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 15/29] 10.222.0.86 () {60 vars in 1131 bytes} [Fri Jul 15 16:24:11 2022] POST /identity/v3/roles => generated 219 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 16:24:12.193133 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb21ea2-3b59-4d40-9124-f00ff3993ba8 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:12.194954 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb21ea2-3b59-4d40-9124-f00ff3993ba8 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:12.195445 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb21ea2-3b59-4d40-9124-f00ff3993ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:12.235306 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-dcb21ea2-3b59-4d40-9124-f00ff3993ba8 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:12.237360 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-dcb21ea2-3b59-4d40-9124-f00ff3993ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:12.359282 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 16/30] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:12.372102 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc17a3-9d81-4e74-91da-6ed653af9e50 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:12.400427 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb21ea2-3b59-4d40-9124-f00ff3993ba8 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:12.432241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66a980-27f6-43bf-bd16-3ecb593e9676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:12.433637 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66a980-27f6-43bf-bd16-3ecb593e9676 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:12.434134 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66a980-27f6-43bf-bd16-3ecb593e9676 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:12.434622 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66a980-27f6-43bf-bd16-3ecb593e9676 None admin] PATH_INFO: `/v3/users/44293b77272f4265bf2e4dd85cca6be9` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:12.436520 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66a980-27f6-43bf-bd16-3ecb593e9676 None admin] RBAC: Authorizing `identity:get_user(user_id=44293b77272f4265bf2e4dd85cca6be9)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:12.438906 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66a980-27f6-43bf-bd16-3ecb593e9676 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:12.440978 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 15/31] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:12 2022] GET /identity/v3/users/44293b77272f4265bf2e4dd85cca6be9 => generated 247 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:12.446293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66a980-27f6-43bf-bd16-3ecb593e9676 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:12.490154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:12.523413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:12.565672 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66a980-27f6-43bf-bd16-3ecb593e9676 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:12.589235 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb21ea2-3b59-4d40-9124-f00ff3993ba8 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:12.603587 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4be96b-b346-4a31-abe9-a580f00cd2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:12.604628 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4be96b-b346-4a31-abe9-a580f00cd2af None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:12.605060 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4be96b-b346-4a31-abe9-a580f00cd2af None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:12.605484 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4be96b-b346-4a31-abe9-a580f00cd2af None admin] PATH_INFO: `/v3/domains/default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:12.607721 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4be96b-b346-4a31-abe9-a580f00cd2af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:12.609575 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4be96b-b346-4a31-abe9-a580f00cd2af None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:12.611586 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 16/32] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:12.612963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae33d53-f43e-4f91-ac8c-58819fcc5716 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:12.613418 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae33d53-f43e-4f91-ac8c-58819fcc5716 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:12.613844 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae33d53-f43e-4f91-ac8c-58819fcc5716 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:12.617023 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 17/33] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:12.623178 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae33d53-f43e-4f91-ac8c-58819fcc5716 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:12.632599 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cab52a-7993-43d4-9818-408d11e5c682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:12.633703 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cab52a-7993-43d4-9818-408d11e5c682 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:12.634195 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cab52a-7993-43d4-9818-408d11e5c682 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:12.634697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cab52a-7993-43d4-9818-408d11e5c682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:12.647389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cab52a-7993-43d4-9818-408d11e5c682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:12.649517 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cab52a-7993-43d4-9818-408d11e5c682 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:12.671636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-a8cab52a-7993-43d4-9818-408d11e5c682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:24:12.671636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:12.671636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:12.671636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:12.671636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:12.671636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:12.671636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:12.671636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:12.671636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:12.671636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:12.671636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:12.671636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:12.671636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:24:12.671636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:24:12.671636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:12.672559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:12.673476 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:24:12.673476 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:24:12.673476 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:24:12.673476 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:12.675624 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 17/34] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:24:12.677279 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeb51d-4c7d-43b9-892a-51d9515a1076 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:12.677806 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeb51d-4c7d-43b9-892a-51d9515a1076 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:12.678435 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeb51d-4c7d-43b9-892a-51d9515a1076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:12.698568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-00aeb51d-4c7d-43b9-892a-51d9515a1076 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:12.700438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-00aeb51d-4c7d-43b9-892a-51d9515a1076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:12.742540 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae33d53-f43e-4f91-ac8c-58819fcc5716 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:12.745095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:12.781810 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34600c0c-93fe-41d1-adb2-21dce37c0a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:12.782695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34600c0c-93fe-41d1-adb2-21dce37c0a8e None admin] REQUEST_METHOD: `PUT` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:12.783007 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34600c0c-93fe-41d1-adb2-21dce37c0a8e None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:12.783290 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34600c0c-93fe-41d1-adb2-21dce37c0a8e None admin] PATH_INFO: `/v3/domains/default/users/44293b77272f4265bf2e4dd85cca6be9/roles/923dd61feaca45d0933a4601fb2c065b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:12.785632 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34600c0c-93fe-41d1-adb2-21dce37c0a8e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=44293b77272f4265bf2e4dd85cca6be9, role_id=923dd61feaca45d0933a4601fb2c065b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:12.787134 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34600c0c-93fe-41d1-adb2-21dce37c0a8e None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:12.790104 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 18/35] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:12.791274 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aeb51d-4c7d-43b9-892a-51d9515a1076 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:12.849698 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:12.916906 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aeb51d-4c7d-43b9-892a-51d9515a1076 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:12.949894 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 18/36] 10.222.0.86 () {58 vars in 1361 bytes} [Fri Jul 15 16:24:12 2022] PUT /identity/v3/domains/default/users/44293b77272f4265bf2e4dd85cca6be9/roles/923dd61feaca45d0933a4601fb2c065b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:24:12.950992 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34600c0c-93fe-41d1-adb2-21dce37c0a8e None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:12.969523 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcefeeb-bdfe-48b4-aaa3-412880028cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:12.970807 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcefeeb-bdfe-48b4-aaa3-412880028cec None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:12.971900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcefeeb-bdfe-48b4-aaa3-412880028cec None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:12.972414 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcefeeb-bdfe-48b4-aaa3-412880028cec None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:12.973654 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcefeeb-bdfe-48b4-aaa3-412880028cec None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:12.974126 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcefeeb-bdfe-48b4-aaa3-412880028cec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:12.976504 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcefeeb-bdfe-48b4-aaa3-412880028cec None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:12.997866 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 19/37] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:12.999730 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4933d2f-bf2e-471b-adb7-e689db437217 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:12.999730 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4933d2f-bf2e-471b-adb7-e689db437217 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:12.999969 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4933d2f-bf2e-471b-adb7-e689db437217 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:13.001499 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 20/38] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:13.011407 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c4ffb-574a-4fb5-9187-7e8bec04da71 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:13.011802 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c4ffb-574a-4fb5-9187-7e8bec04da71 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:13.012285 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c4ffb-574a-4fb5-9187-7e8bec04da71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:13.031902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-dc4c4ffb-574a-4fb5-9187-7e8bec04da71 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:13.033710 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-dc4c4ffb-574a-4fb5-9187-7e8bec04da71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:13.080034 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34600c0c-93fe-41d1-adb2-21dce37c0a8e None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:13.112744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 21/39] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:13.120175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c4ffb-574a-4fb5-9187-7e8bec04da71 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:13.121773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14294f0-a4ad-4c11-b933-8743250cbafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:13.122731 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14294f0-a4ad-4c11-b933-8743250cbafb None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:13.123244 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14294f0-a4ad-4c11-b933-8743250cbafb None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:13.123689 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14294f0-a4ad-4c11-b933-8743250cbafb None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:13.125199 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14294f0-a4ad-4c11-b933-8743250cbafb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:13.127456 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14294f0-a4ad-4c11-b933-8743250cbafb None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:13.151195 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 19/40] 10.222.0.86 () {60 vars in 1131 bytes} [Fri Jul 15 16:24:12 2022] POST /identity/v3/roles => generated 225 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:24:13.153180 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafb684-4fe3-4bb2-ad0f-669bbff873b5 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:13.153604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafb684-4fe3-4bb2-ad0f-669bbff873b5 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:13.153796 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafb684-4fe3-4bb2-ad0f-669bbff873b5 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:13.155088 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 20/41] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:13.155864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafb684-4fe3-4bb2-ad0f-669bbff873b5 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:13.164540 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:13.188918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:13.246765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c4ffb-574a-4fb5-9187-7e8bec04da71 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:13.284879 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafb684-4fe3-4bb2-ad0f-669bbff873b5 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:13.286053 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ea411-005e-40d9-b12d-eab21fd52530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:13.286741 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ea411-005e-40d9-b12d-eab21fd52530 None admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:13.287069 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ea411-005e-40d9-b12d-eab21fd52530 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:13.287355 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ea411-005e-40d9-b12d-eab21fd52530 None admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:13.288093 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ea411-005e-40d9-b12d-eab21fd52530 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:13.289673 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ea411-005e-40d9-b12d-eab21fd52530 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:13.327069 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3e89c-7c2a-47fa-82fe-f89dc86fd31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:13.327938 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3e89c-7c2a-47fa-82fe-f89dc86fd31e None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:13.328281 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3e89c-7c2a-47fa-82fe-f89dc86fd31e None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:13.328569 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3e89c-7c2a-47fa-82fe-f89dc86fd31e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:13.329967 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3e89c-7c2a-47fa-82fe-f89dc86fd31e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:13.331603 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3e89c-7c2a-47fa-82fe-f89dc86fd31e None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:13.333375 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 21/43] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:13.333777 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 22/43] 10.222.0.86 () {60 vars in 1141 bytes} [Fri Jul 15 16:24:13 2022] POST /identity/v3/projects => generated 301 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:24:13.334774 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c98e5b-4a2f-42d2-b286-2f0a05687305 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:13.335035 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c98e5b-4a2f-42d2-b286-2f0a05687305 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:13.335322 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c98e5b-4a2f-42d2-b286-2f0a05687305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:13.339371 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ea411-005e-40d9-b12d-eab21fd52530 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:13.356325 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-a0c98e5b-4a2f-42d2-b286-2f0a05687305 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:13.359825 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-a0c98e5b-4a2f-42d2-b286-2f0a05687305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:13.455290 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:13.471520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ea411-005e-40d9-b12d-eab21fd52530 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:13.495032 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 22/44] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:13.519656 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11882a43-b58f-4661-b30c-9dea7475569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:13.520341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11882a43-b58f-4661-b30c-9dea7475569f None admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:13.520638 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11882a43-b58f-4661-b30c-9dea7475569f None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:13.520926 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11882a43-b58f-4661-b30c-9dea7475569f None admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:13.521658 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11882a43-b58f-4661-b30c-9dea7475569f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:13.523391 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11882a43-b58f-4661-b30c-9dea7475569f None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:13.527893 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c98e5b-4a2f-42d2-b286-2f0a05687305 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:13.557023 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 23/45] 10.222.0.86 () {60 vars in 1141 bytes} [Fri Jul 15 16:24:13 2022] POST /identity/v3/projects => generated 312 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 16:24:13.561303 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:13.653961 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c98e5b-4a2f-42d2-b286-2f0a05687305 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:13.697213 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529a310-8beb-4a30-b8ae-d6d3b164adce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:13.697908 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529a310-8beb-4a30-b8ae-d6d3b164adce None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:13.698200 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529a310-8beb-4a30-b8ae-d6d3b164adce None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:13.698483 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529a310-8beb-4a30-b8ae-d6d3b164adce None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:13.699279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529a310-8beb-4a30-b8ae-d6d3b164adce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:13.700688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529a310-8beb-4a30-b8ae-d6d3b164adce None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:13.723011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 23/46] 10.222.0.86 () {60 vars in 1131 bytes} [Fri Jul 15 16:24:13 2022] POST /identity/v3/roles => generated 223 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 16:24:15.270743 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b91d3-e593-4a4c-ac7f-d3a6ef107a07 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:15.271283 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b91d3-e593-4a4c-ac7f-d3a6ef107a07 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:15.271387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b91d3-e593-4a4c-ac7f-d3a6ef107a07 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:15.272729 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 24/47] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:15.278064 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d69dd-7da0-4709-9d31-7a0c16d1d2d8 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:15.278465 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d69dd-7da0-4709-9d31-7a0c16d1d2d8 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:15.278624 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d69dd-7da0-4709-9d31-7a0c16d1d2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:15.295988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-ed5d69dd-7da0-4709-9d31-7a0c16d1d2d8 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:15.297677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-ed5d69dd-7da0-4709-9d31-7a0c16d1d2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:15.362315 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 24/48] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:15.386341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b91d3-e593-4a4c-ac7f-d3a6ef107a07 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:15.486541 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b91d3-e593-4a4c-ac7f-d3a6ef107a07 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:15.519853 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83974a-f1d5-4fcd-bebf-be91ad7953d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:15.520643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83974a-f1d5-4fcd-bebf-be91ad7953d8 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:15.520978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83974a-f1d5-4fcd-bebf-be91ad7953d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:15.521214 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83974a-f1d5-4fcd-bebf-be91ad7953d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:15.528874 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:15.532288 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83974a-f1d5-4fcd-bebf-be91ad7953d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-3d83974a-f1d5-4fcd-bebf-be91ad7953d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:15.540745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:15.541614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:15.542361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:15.542361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:15.542361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:15.542361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:15.542361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:15.542361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:15.542361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:15.542361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:15.542361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:15.542361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:15.542361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:15.542361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:15.542998 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 25/49] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:24:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:15.549667 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d69dd-7da0-4709-9d31-7a0c16d1d2d8 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:15.564087 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:15.652666 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d69dd-7da0-4709-9d31-7a0c16d1d2d8 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:15.689763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312825bf-aef6-43db-bb3f-3a9826d62f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:15.690426 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312825bf-aef6-43db-bb3f-3a9826d62f11 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:15.690715 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312825bf-aef6-43db-bb3f-3a9826d62f11 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:15.691038 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312825bf-aef6-43db-bb3f-3a9826d62f11 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:15.691798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312825bf-aef6-43db-bb3f-3a9826d62f11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:15.692109 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312825bf-aef6-43db-bb3f-3a9826d62f11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:15.693523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312825bf-aef6-43db-bb3f-3a9826d62f11 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:15.701882 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 25/50] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:15.707948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83974a-f1d5-4fcd-bebf-be91ad7953d8 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:15.800864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc86a2-feab-4a31-bffa-7c82b298c68e None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:15.801070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc86a2-feab-4a31-bffa-7c82b298c68e None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:15.801332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc86a2-feab-4a31-bffa-7c82b298c68e None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:15.802684 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 26/51] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:24:15.807552 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52369d60-eb3e-4ac0-bc82-55419ac5233f None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:15.807839 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52369d60-eb3e-4ac0-bc82-55419ac5233f None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:15.808119 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52369d60-eb3e-4ac0-bc82-55419ac5233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:15.808892 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83974a-f1d5-4fcd-bebf-be91ad7953d8 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:15.824521 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-52369d60-eb3e-4ac0-bc82-55419ac5233f None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:15.825697 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-52369d60-eb3e-4ac0-bc82-55419ac5233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:15.842084 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ed72b-82f3-4eff-858e-cdf178542dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:15.843009 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ed72b-82f3-4eff-858e-cdf178542dfa None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:15.843302 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ed72b-82f3-4eff-858e-cdf178542dfa None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:15.843585 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ed72b-82f3-4eff-858e-cdf178542dfa None admin] PATH_INFO: `/v3/users/44293b77272f4265bf2e4dd85cca6be9` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:15.844758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ed72b-82f3-4eff-858e-cdf178542dfa None admin] RBAC: Authorizing `identity:get_user(user_id=44293b77272f4265bf2e4dd85cca6be9)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:15.846215 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ed72b-82f3-4eff-858e-cdf178542dfa None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:15.847854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 26/52] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:15 2022] GET /identity/v3/users/44293b77272f4265bf2e4dd85cca6be9 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:15.853118 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ed72b-82f3-4eff-858e-cdf178542dfa None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:15.896174 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 27/53] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:15.920635 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52369d60-eb3e-4ac0-bc82-55419ac5233f None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:15.921883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:15.924937 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:15.955839 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ed72b-82f3-4eff-858e-cdf178542dfa None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:15.989908 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c112b-7ce5-449a-a6d6-d013601145f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:15.998982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c112b-7ce5-449a-a6d6-d013601145f2 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:15.999298 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c112b-7ce5-449a-a6d6-d013601145f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:15.999603 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c112b-7ce5-449a-a6d6-d013601145f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:16.000902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c112b-7ce5-449a-a6d6-d013601145f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:16.002379 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c112b-7ce5-449a-a6d6-d013601145f2 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:16.004053 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 27/54] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:16.009710 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c112b-7ce5-449a-a6d6-d013601145f2 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:16.028322 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52369d60-eb3e-4ac0-bc82-55419ac5233f None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:16.062122 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ba80-0a8f-498f-85d4-01145dcb9bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:16.062990 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ba80-0a8f-498f-85d4-01145dcb9bfe None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:16.063352 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ba80-0a8f-498f-85d4-01145dcb9bfe None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:16.063641 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ba80-0a8f-498f-85d4-01145dcb9bfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:16.064834 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5ba80-0a8f-498f-85d4-01145dcb9bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:16.066276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5ba80-0a8f-498f-85d4-01145dcb9bfe None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:16.067973 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 28/55] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:16.073584 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ba80-0a8f-498f-85d4-01145dcb9bfe None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:16.107963 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c112b-7ce5-449a-a6d6-d013601145f2 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:16.140635 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2139bc-4053-48d4-a8fa-d6bdce6462ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:16.141298 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2139bc-4053-48d4-a8fa-d6bdce6462ed None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:16.141594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2139bc-4053-48d4-a8fa-d6bdce6462ed None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:16.141880 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2139bc-4053-48d4-a8fa-d6bdce6462ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:16.142154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:16.142711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2139bc-4053-48d4-a8fa-d6bdce6462ed None admin] RBAC: Adding query filter params (role.id=923dd61feaca45d0933a4601fb2c065b, scope.domain.id=default, user.id=44293b77272f4265bf2e4dd85cca6be9) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:16.143130 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2139bc-4053-48d4-a8fa-d6bdce6462ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:16.144607 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2139bc-4053-48d4-a8fa-d6bdce6462ed None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:16.147545 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:16.155072 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 28/56] 10.222.0.86 () {56 vars in 1322 bytes} [Fri Jul 15 16:24:16 2022] GET /identity/v3/role_assignments?user.id=44293b77272f4265bf2e4dd85cca6be9&scope.domain.id=default&role.id=923dd61feaca45d0933a4601fb2c065b => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:16.174639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ba80-0a8f-498f-85d4-01145dcb9bfe None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:16.211106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d71e5b-22f5-4ad8-b397-aad556b62e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:16.211794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d71e5b-22f5-4ad8-b397-aad556b62e5f None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:16.212081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d71e5b-22f5-4ad8-b397-aad556b62e5f None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:16.212376 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d71e5b-22f5-4ad8-b397-aad556b62e5f None admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:16.213089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d71e5b-22f5-4ad8-b397-aad556b62e5f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:16.214568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d71e5b-22f5-4ad8-b397-aad556b62e5f None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:16.246376 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 29/57] 10.222.0.86 () {60 vars in 1140 bytes} [Fri Jul 15 16:24:16 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 16:24:18.457033 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de6cff-8c8c-4752-9638-758a43d77502 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:18.457594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de6cff-8c8c-4752-9638-758a43d77502 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:18.457594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de6cff-8c8c-4752-9638-758a43d77502 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:18.458990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 29/58] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:18.464039 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915e3fa-6b36-4045-95a6-37da0334324c None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:18.464450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915e3fa-6b36-4045-95a6-37da0334324c None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:18.464606 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915e3fa-6b36-4045-95a6-37da0334324c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:18.482168 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-2915e3fa-6b36-4045-95a6-37da0334324c None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:18.484035 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-2915e3fa-6b36-4045-95a6-37da0334324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:18.547516 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 30/59] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:18.572451 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de6cff-8c8c-4752-9638-758a43d77502 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:18.672570 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de6cff-8c8c-4752-9638-758a43d77502 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:18.705022 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a743e3-5532-4c3f-829e-0eb6f81b815f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:18.705815 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a743e3-5532-4c3f-829e-0eb6f81b815f None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:18.706107 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a743e3-5532-4c3f-829e-0eb6f81b815f None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:18.706390 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a743e3-5532-4c3f-829e-0eb6f81b815f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:18.707600 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a743e3-5532-4c3f-829e-0eb6f81b815f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:18.709007 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a743e3-5532-4c3f-829e-0eb6f81b815f None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:18.710611 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 30/60] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:18.716178 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915e3fa-6b36-4045-95a6-37da0334324c None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:18.769314 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:18.813641 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915e3fa-6b36-4045-95a6-37da0334324c None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:18.846825 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e719a9-8d75-4ce7-b4b5-4d567f3f7d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:18.847552 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e719a9-8d75-4ce7-b4b5-4d567f3f7d5d None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:18.847840 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e719a9-8d75-4ce7-b4b5-4d567f3f7d5d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:18.848120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e719a9-8d75-4ce7-b4b5-4d567f3f7d5d None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:18.848835 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e719a9-8d75-4ce7-b4b5-4d567f3f7d5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:18.850290 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e719a9-8d75-4ce7-b4b5-4d567f3f7d5d None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:18.876346 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 31/61] 10.222.0.86 () {60 vars in 1132 bytes} [Fri Jul 15 16:24:18 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:24:22.244738 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750bc29-bd94-4da2-a03e-5ea9165f72af None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:22.245771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750bc29-bd94-4da2-a03e-5ea9165f72af None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:22.246287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750bc29-bd94-4da2-a03e-5ea9165f72af None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:22.247889 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 31/62] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:22.260538 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52c810-b32b-4bdd-8144-409f034282cf None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:22.261458 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52c810-b32b-4bdd-8144-409f034282cf None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:22.261938 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52c810-b32b-4bdd-8144-409f034282cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:22.285499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-2f52c810-b32b-4bdd-8144-409f034282cf None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:22.287070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-2f52c810-b32b-4bdd-8144-409f034282cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:22.373207 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 32/63] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:22.413277 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750bc29-bd94-4da2-a03e-5ea9165f72af None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:22.506647 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:22.559587 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750bc29-bd94-4da2-a03e-5ea9165f72af None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:22.604731 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf489c1-4c1d-4068-9f5d-32d6b9704fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:22.605543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf489c1-4c1d-4068-9f5d-32d6b9704fe3 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:22.605837 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf489c1-4c1d-4068-9f5d-32d6b9704fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:22.606119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf489c1-4c1d-4068-9f5d-32d6b9704fe3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:22.620626 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f84da-4778-4102-9793-34fc99d655f9 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:22.621120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f84da-4778-4102-9793-34fc99d655f9 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:22.621635 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f84da-4778-4102-9793-34fc99d655f9 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:22.623247 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 33/64] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:24:22.626536 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf489c1-4c1d-4068-9f5d-32d6b9704fe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-adf489c1-4c1d-4068-9f5d-32d6b9704fe3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:22.634383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:22.635268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:22.636021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:22.636021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:22.636021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:22.636021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:22.636021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:22.636021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:22.636021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:22.636021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:22.636021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:22.636021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:22.636021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:22.636021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:22.636021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 32/65] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:22.640962 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efa37b-bd14-4b80-a926-1759472a8d82 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:22.641262 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efa37b-bd14-4b80-a926-1759472a8d82 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:22.641543 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efa37b-bd14-4b80-a926-1759472a8d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:22.643801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf489c1-4c1d-4068-9f5d-32d6b9704fe3 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:22.675636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-28efa37b-bd14-4b80-a926-1759472a8d82 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:22.677083 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-28efa37b-bd14-4b80-a926-1759472a8d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:22.723560 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:22.760011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 34/66] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:22.761799 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84ec52-33be-48b1-adc4-a9dcd9aa4cd8 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:22.762168 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84ec52-33be-48b1-adc4-a9dcd9aa4cd8 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:22.762523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84ec52-33be-48b1-adc4-a9dcd9aa4cd8 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:22.763915 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 35/67] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:22.769694 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4a1c0-e441-41b6-bdb5-1288fbe822b3 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:22.770194 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4a1c0-e441-41b6-bdb5-1288fbe822b3 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:22.770680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4a1c0-e441-41b6-bdb5-1288fbe822b3 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:22.772139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 36/68] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:22.777594 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f30ab4-f320-4478-921d-f88588071772 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:22.778782 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f30ab4-f320-4478-921d-f88588071772 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:22.779271 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f30ab4-f320-4478-921d-f88588071772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:22.790257 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf489c1-4c1d-4068-9f5d-32d6b9704fe3 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:22.806699 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-01f30ab4-f320-4478-921d-f88588071772 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:22.807944 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-01f30ab4-f320-4478-921d-f88588071772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:22.819658 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:22.830625 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4d10-e40e-4af7-9fe8-9dee8fa0c4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:22.831357 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4d10-e40e-4af7-9fe8-9dee8fa0c4bd None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:22.831652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4d10-e40e-4af7-9fe8-9dee8fa0c4bd None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:22.831932 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4d10-e40e-4af7-9fe8-9dee8fa0c4bd None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:22.832686 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f4d10-e40e-4af7-9fe8-9dee8fa0c4bd None admin] RBAC: Adding query filter params (name=member) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:22.833003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f4d10-e40e-4af7-9fe8-9dee8fa0c4bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:22.834390 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f4d10-e40e-4af7-9fe8-9dee8fa0c4bd None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:22.842980 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 33/69] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:22.844184 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d598f-b674-43c8-80f7-bff64cfd571a None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:22.844627 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d598f-b674-43c8-80f7-bff64cfd571a None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:22.845005 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d598f-b674-43c8-80f7-bff64cfd571a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:22.867652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-541d598f-b674-43c8-80f7-bff64cfd571a None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:22.868864 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-541d598f-b674-43c8-80f7-bff64cfd571a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:22.886278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 37/70] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:22.887150 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f30ab4-f320-4478-921d-f88588071772 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:22.938243 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 34/71] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:22.939124 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d598f-b674-43c8-80f7-bff64cfd571a None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:22.986042 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:22.989194 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f30ab4-f320-4478-921d-f88588071772 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:23.022786 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0862441-28b0-47b9-b3be-977d4abcfed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:23.023536 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0862441-28b0-47b9-b3be-977d4abcfed8 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:23.023826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0862441-28b0-47b9-b3be-977d4abcfed8 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:23.024110 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0862441-28b0-47b9-b3be-977d4abcfed8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:23.034477 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0862441-28b0-47b9-b3be-977d4abcfed8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:23.036993 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d598f-b674-43c8-80f7-bff64cfd571a None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-e0862441-28b0-47b9-b3be-977d4abcfed8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:23.042330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:23.043365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:23.044250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:23.044250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:23.044250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:23.044250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:23.044250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:23.044250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:23.044250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:23.044250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:23.044250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:23.044250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:23.044250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:23.044250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:23.044250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 38/72] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:23.044857 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465be80-b4dc-418f-bbb9-ec36758c5952 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:23.045088 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465be80-b4dc-418f-bbb9-ec36758c5952 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:23.045370 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465be80-b4dc-418f-bbb9-ec36758c5952 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:23.046714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 39/73] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:23.047444 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465be80-b4dc-418f-bbb9-ec36758c5952 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:23.061032 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:23.075141 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737921c6-220a-412f-8824-1debf36eb1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:23.076015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737921c6-220a-412f-8824-1debf36eb1fc None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:23.076560 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737921c6-220a-412f-8824-1debf36eb1fc None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:23.076839 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737921c6-220a-412f-8824-1debf36eb1fc None admin] PATH_INFO: `/v3/users/616e5238fb534043a0db27a9e7971c92` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:23.090431 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737921c6-220a-412f-8824-1debf36eb1fc None admin] RBAC: Authorizing `identity:get_user(user_id=616e5238fb534043a0db27a9e7971c92)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:23.091920 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737921c6-220a-412f-8824-1debf36eb1fc None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:23.094336 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 35/74] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:22 2022] GET /identity/v3/users/616e5238fb534043a0db27a9e7971c92 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:23.095130 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737921c6-220a-412f-8824-1debf36eb1fc None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:23.151526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465be80-b4dc-418f-bbb9-ec36758c5952 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:23.185791 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb718d-ae3e-41bf-951a-0bfbe2116ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:23.186690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb718d-ae3e-41bf-951a-0bfbe2116ebf None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:23.187077 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb718d-ae3e-41bf-951a-0bfbe2116ebf None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:23.187424 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb718d-ae3e-41bf-951a-0bfbe2116ebf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:23.190408 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737921c6-220a-412f-8824-1debf36eb1fc None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:23.197351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb718d-ae3e-41bf-951a-0bfbe2116ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-99fb718d-ae3e-41bf-951a-0bfbe2116ebf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:23.205742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:23.206561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:23.207350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:23.207350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:23.207350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:23.207350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:23.207350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:23.207350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:23.207350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:23.207350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:23.207350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:23.207350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:23.207350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:23.207350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:23.207350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 40/75] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:24:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:23.208311 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb718d-ae3e-41bf-951a-0bfbe2116ebf None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:23.226734 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03dd53-4f60-4c5e-85c7-59049244cf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:23.227467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03dd53-4f60-4c5e-85c7-59049244cf9e None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:23.227762 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03dd53-4f60-4c5e-85c7-59049244cf9e None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:23.228048 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03dd53-4f60-4c5e-85c7-59049244cf9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:23.230459 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:23.238620 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03dd53-4f60-4c5e-85c7-59049244cf9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-2e03dd53-4f60-4c5e-85c7-59049244cf9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:23.246588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:23.247999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:23.248745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:23.248745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:23.248745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:23.248745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:23.248745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:23.248745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:23.248745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:23.248745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:23.248745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:23.248745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:23.248745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:24:23.248745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:23.248745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 36/76] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:24:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:23.249484 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68b816-8aa1-4809-a09d-9075bd096e81 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:23.249484 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68b816-8aa1-4809-a09d-9075bd096e81 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:23.249603 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68b816-8aa1-4809-a09d-9075bd096e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:23.266790 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-2f68b816-8aa1-4809-a09d-9075bd096e81 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:23.268011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-2f68b816-8aa1-4809-a09d-9075bd096e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:23.297688 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:23.312390 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb718d-ae3e-41bf-951a-0bfbe2116ebf None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:23.334881 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 37/77] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:23.339725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68b816-8aa1-4809-a09d-9075bd096e81 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:23.346519 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7dded-bbbf-40f5-b3e7-1623c637ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:23.347219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7dded-bbbf-40f5-b3e7-1623c637ad44 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:23.347910 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7dded-bbbf-40f5-b3e7-1623c637ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:23.348212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7dded-bbbf-40f5-b3e7-1623c637ad44 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:23.348949 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7dded-bbbf-40f5-b3e7-1623c637ad44 None admin] RBAC: Adding query filter params (name=member) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:23.349596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7dded-bbbf-40f5-b3e7-1623c637ad44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:23.351329 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7dded-bbbf-40f5-b3e7-1623c637ad44 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:23.362475 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 41/78] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:23.363308 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7dded-bbbf-40f5-b3e7-1623c637ad44 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:23.443089 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68b816-8aa1-4809-a09d-9075bd096e81 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:23.444775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:23.463731 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7dded-bbbf-40f5-b3e7-1623c637ad44 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:23.477567 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96212ab-493c-4f74-9581-ec5a703361b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:23.478202 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96212ab-493c-4f74-9581-ec5a703361b5 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:23.478488 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96212ab-493c-4f74-9581-ec5a703361b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:23.478765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96212ab-493c-4f74-9581-ec5a703361b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:23.497613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ec7fe-3f7a-4415-9fa7-cafc6d64235f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:23.498272 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ec7fe-3f7a-4415-9fa7-cafc6d64235f None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:23.498561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ec7fe-3f7a-4415-9fa7-cafc6d64235f None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:23.498889 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ec7fe-3f7a-4415-9fa7-cafc6d64235f None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:23.499669 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ec7fe-3f7a-4415-9fa7-cafc6d64235f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:23.499984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ec7fe-3f7a-4415-9fa7-cafc6d64235f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:23.501405 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ec7fe-3f7a-4415-9fa7-cafc6d64235f None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:23.509249 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 42/79] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:23.510222 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ec7fe-3f7a-4415-9fa7-cafc6d64235f None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:23.514495 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:23.547825 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96212ab-493c-4f74-9581-ec5a703361b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:23.549233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96212ab-493c-4f74-9581-ec5a703361b5 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:23.607451 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ec7fe-3f7a-4415-9fa7-cafc6d64235f None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:23.642280 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c6d22-9c9e-4c33-b322-a82798aace32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:23.642967 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c6d22-9c9e-4c33-b322-a82798aace32 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:23.643258 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c6d22-9c9e-4c33-b322-a82798aace32 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:23.643541 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c6d22-9c9e-4c33-b322-a82798aace32 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:23.644284 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c6d22-9c9e-4c33-b322-a82798aace32 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:23.644598 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c6d22-9c9e-4c33-b322-a82798aace32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:23.645953 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c6d22-9c9e-4c33-b322-a82798aace32 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:23.650128 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 38/80] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:23.650982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96212ab-493c-4f74-9581-ec5a703361b5 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:23.662512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 43/81] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:24:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:23.662512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c6d22-9c9e-4c33-b322-a82798aace32 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:23.667463 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:23.721324 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:23.754667 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96212ab-493c-4f74-9581-ec5a703361b5 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:23.758351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c6d22-9c9e-4c33-b322-a82798aace32 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:23.788352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436605f-c378-4d51-8003-88dbbd6e72ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:23.789144 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436605f-c378-4d51-8003-88dbbd6e72ec None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:23.789442 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436605f-c378-4d51-8003-88dbbd6e72ec None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:23.789727 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436605f-c378-4d51-8003-88dbbd6e72ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:23.790957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436605f-c378-4d51-8003-88dbbd6e72ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:23.791062 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92fb7b-26f0-4b94-871b-0e1afae575e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:23.791789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92fb7b-26f0-4b94-871b-0e1afae575e8 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:23.792079 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92fb7b-26f0-4b94-871b-0e1afae575e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:23.792360 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92fb7b-26f0-4b94-871b-0e1afae575e8 None admin] PATH_INFO: `/v3/users/616e5238fb534043a0db27a9e7971c92` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:23.792464 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436605f-c378-4d51-8003-88dbbd6e72ec None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:23.793567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92fb7b-26f0-4b94-871b-0e1afae575e8 None admin] RBAC: Authorizing `identity:get_user(user_id=616e5238fb534043a0db27a9e7971c92)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:23.794457 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 39/82] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:23.795032 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92fb7b-26f0-4b94-871b-0e1afae575e8 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:23.795127 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436605f-c378-4d51-8003-88dbbd6e72ec None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:23.797348 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 44/83] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:23 2022] GET /identity/v3/users/616e5238fb534043a0db27a9e7971c92 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:23.797993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92fb7b-26f0-4b94-871b-0e1afae575e8 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:23.880023 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:23.904789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92fb7b-26f0-4b94-871b-0e1afae575e8 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:23.906884 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436605f-c378-4d51-8003-88dbbd6e72ec None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:23.938917 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820a99b-0399-4e13-9db0-c46e5deb5717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:23.939777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820a99b-0399-4e13-9db0-c46e5deb5717 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:23.940061 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820a99b-0399-4e13-9db0-c46e5deb5717 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:23.940337 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820a99b-0399-4e13-9db0-c46e5deb5717 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:23.941124 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dbfe2-b6c7-4270-93cd-cd93bd42d5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:23.941515 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820a99b-0399-4e13-9db0-c46e5deb5717 None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:23.942000 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dbfe2-b6c7-4270-93cd-cd93bd42d5e2 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:23.942291 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dbfe2-b6c7-4270-93cd-cd93bd42d5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:23.942571 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dbfe2-b6c7-4270-93cd-cd93bd42d5e2 None admin] PATH_INFO: `/v3/users/44293b77272f4265bf2e4dd85cca6be9` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:23.942998 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820a99b-0399-4e13-9db0-c46e5deb5717 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:23.943809 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5dbfe2-b6c7-4270-93cd-cd93bd42d5e2 None admin] RBAC: Authorizing `identity:get_user(user_id=44293b77272f4265bf2e4dd85cca6be9)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:23.944697 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 45/84] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:23 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:23.945251 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5dbfe2-b6c7-4270-93cd-cd93bd42d5e2 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:23.945451 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820a99b-0399-4e13-9db0-c46e5deb5717 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:23.947066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 40/85] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:23 2022] GET /identity/v3/users/44293b77272f4265bf2e4dd85cca6be9 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:23.951904 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dbfe2-b6c7-4270-93cd-cd93bd42d5e2 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:23.955460 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:24.045398 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820a99b-0399-4e13-9db0-c46e5deb5717 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:24.049424 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dbfe2-b6c7-4270-93cd-cd93bd42d5e2 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:24.079740 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8087-bd88-4f4b-a380-cd1c098e765a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:24.080608 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8087-bd88-4f4b-a380-cd1c098e765a None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:24.080896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8087-bd88-4f4b-a380-cd1c098e765a None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:24.081175 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8087-bd88-4f4b-a380-cd1c098e765a None admin] PATH_INFO: `/v3/users/616e5238fb534043a0db27a9e7971c92` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:24.082367 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae8087-bd88-4f4b-a380-cd1c098e765a None admin] RBAC: Authorizing `identity:get_user(user_id=616e5238fb534043a0db27a9e7971c92)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:24.087276 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc11cc-bef6-4e93-9fc0-59eb3e20e3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:24.087949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc11cc-bef6-4e93-9fc0-59eb3e20e3f1 None admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:24.088239 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc11cc-bef6-4e93-9fc0-59eb3e20e3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:24.088526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc11cc-bef6-4e93-9fc0-59eb3e20e3f1 None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:24.089241 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc11cc-bef6-4e93-9fc0-59eb3e20e3f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:24.090692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc11cc-bef6-4e93-9fc0-59eb3e20e3f1 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:24.092616 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae8087-bd88-4f4b-a380-cd1c098e765a None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:24.094350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 46/86] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:23 2022] GET /identity/v3/users/616e5238fb534043a0db27a9e7971c92 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:24.095225 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8087-bd88-4f4b-a380-cd1c098e765a None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:24.107978 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:24.117529 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 41/87] 10.222.0.86 () {60 vars in 1132 bytes} [Fri Jul 15 16:24:23 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:24:24.118294 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc11cc-bef6-4e93-9fc0-59eb3e20e3f1 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:24.187151 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:24.223764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8087-bd88-4f4b-a380-cd1c098e765a None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:24.232654 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc11cc-bef6-4e93-9fc0-59eb3e20e3f1 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:24.263117 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e1524-70a2-4ad8-9e45-f2f9eb287dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:24.263780 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e1524-70a2-4ad8-9e45-f2f9eb287dfd None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:24.264236 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e1524-70a2-4ad8-9e45-f2f9eb287dfd None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:24.264598 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e1524-70a2-4ad8-9e45-f2f9eb287dfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:24.271446 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab065021-8133-4db8-945f-7755e973b6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:24.272138 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab065021-8133-4db8-945f-7755e973b6cc None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:24.272433 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab065021-8133-4db8-945f-7755e973b6cc None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:24.272720 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab065021-8133-4db8-945f-7755e973b6cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:24.273576 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab065021-8133-4db8-945f-7755e973b6cc None admin] RBAC: Adding query filter params (role.id=3bed7bde1b98412b94a181719432cfa1, scope.project.id=f26148acb7004ff78333b7b62586ed2e, user.id=616e5238fb534043a0db27a9e7971c92) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:24.273900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab065021-8133-4db8-945f-7755e973b6cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:24.275414 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab065021-8133-4db8-945f-7755e973b6cc None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:24.283356 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 42/88] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:24 2022] GET /identity/v3/role_assignments?user.id=616e5238fb534043a0db27a9e7971c92&scope.project.id=f26148acb7004ff78333b7b62586ed2e&role.id=3bed7bde1b98412b94a181719432cfa1 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:24.284568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab065021-8133-4db8-945f-7755e973b6cc None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:24.355246 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e1524-70a2-4ad8-9e45-f2f9eb287dfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:24.357646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e1524-70a2-4ad8-9e45-f2f9eb287dfd None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:24.373315 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:24.423397 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab065021-8133-4db8-945f-7755e973b6cc None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:24.451433 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:24.465768 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1fcb1-05de-42ea-afa2-1ecf5b26612d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:24.467014 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1fcb1-05de-42ea-afa2-1ecf5b26612d None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:24.467342 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1fcb1-05de-42ea-afa2-1ecf5b26612d None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:24.469305 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1fcb1-05de-42ea-afa2-1ecf5b26612d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:24.502536 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 47/89] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:24.504549 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e1524-70a2-4ad8-9e45-f2f9eb287dfd None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:24.572333 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1fcb1-05de-42ea-afa2-1ecf5b26612d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:24.573844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1fcb1-05de-42ea-afa2-1ecf5b26612d None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:24.627601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e1524-70a2-4ad8-9e45-f2f9eb287dfd None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:24.639185 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:24.665499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3dba5-35ea-4714-ab4f-8c95750ff799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:24.666159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3dba5-35ea-4714-ab4f-8c95750ff799 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:24.666447 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3dba5-35ea-4714-ab4f-8c95750ff799 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:24.666727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3dba5-35ea-4714-ab4f-8c95750ff799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:24.713325 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 43/90] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:24.715693 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1fcb1-05de-42ea-afa2-1ecf5b26612d None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:24.768130 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:24.796997 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3dba5-35ea-4714-ab4f-8c95750ff799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:24.798592 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3dba5-35ea-4714-ab4f-8c95750ff799 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:24.883310 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1fcb1-05de-42ea-afa2-1ecf5b26612d None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:24.923600 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0681a-16ac-41be-88ca-c3ba5b093c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:24.924476 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0681a-16ac-41be-88ca-c3ba5b093c92 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:24.924769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0681a-16ac-41be-88ca-c3ba5b093c92 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:24.925053 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0681a-16ac-41be-88ca-c3ba5b093c92 None admin] PATH_INFO: `/v3/projects/d390fb5229214c68b3468da530829773` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:24.926302 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0681a-16ac-41be-88ca-c3ba5b093c92 None admin] RBAC: Authorizing `identity:get_project(project_id=d390fb5229214c68b3468da530829773)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:24.928482 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0681a-16ac-41be-88ca-c3ba5b093c92 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:24.930447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 44/91] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:24 2022] GET /identity/v3/projects/d390fb5229214c68b3468da530829773 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:24.931311 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0681a-16ac-41be-88ca-c3ba5b093c92 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:25.023287 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 48/92] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:25.024527 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3dba5-35ea-4714-ab4f-8c95750ff799 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:25.047432 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0681a-16ac-41be-88ca-c3ba5b093c92 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:25.052478 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:25.057345 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:25.088404 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa73d8f-6066-40a5-91ee-56c5db81e3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:25.089428 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa73d8f-6066-40a5-91ee-56c5db81e3fb None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:25.089822 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa73d8f-6066-40a5-91ee-56c5db81e3fb None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:25.090207 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa73d8f-6066-40a5-91ee-56c5db81e3fb None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:25.091661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa73d8f-6066-40a5-91ee-56c5db81e3fb None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:25.093378 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa73d8f-6066-40a5-91ee-56c5db81e3fb None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:25.095230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 45/93] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:24 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:25.096169 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa73d8f-6066-40a5-91ee-56c5db81e3fb None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:25.200877 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa73d8f-6066-40a5-91ee-56c5db81e3fb None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:25.237888 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27681097-f88a-4c3f-bd43-855ebb2328e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:25.239153 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27681097-f88a-4c3f-bd43-855ebb2328e5 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:25.239519 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27681097-f88a-4c3f-bd43-855ebb2328e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:25.239876 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27681097-f88a-4c3f-bd43-855ebb2328e5 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:25.241308 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27681097-f88a-4c3f-bd43-855ebb2328e5 None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:25.243066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27681097-f88a-4c3f-bd43-855ebb2328e5 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:25.244867 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 46/94] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:25 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:25.250818 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27681097-f88a-4c3f-bd43-855ebb2328e5 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:25.259237 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3dba5-35ea-4714-ab4f-8c95750ff799 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:25.297865 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d5da3-5cb5-4d36-8233-22dbaaca248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:25.299010 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d5da3-5cb5-4d36-8233-22dbaaca248e None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:25.299478 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d5da3-5cb5-4d36-8233-22dbaaca248e None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:25.299974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d5da3-5cb5-4d36-8233-22dbaaca248e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:25.301298 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d5da3-5cb5-4d36-8233-22dbaaca248e None admin] RBAC: Adding query filter params (role.id=3bed7bde1b98412b94a181719432cfa1, scope.project.id=d390fb5229214c68b3468da530829773, user.id=616e5238fb534043a0db27a9e7971c92) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:25.301806 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d5da3-5cb5-4d36-8233-22dbaaca248e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:25.303922 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d5da3-5cb5-4d36-8233-22dbaaca248e None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:25.311236 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:25.319218 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 49/95] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:25 2022] GET /identity/v3/role_assignments?user.id=616e5238fb534043a0db27a9e7971c92&scope.project.id=d390fb5229214c68b3468da530829773&role.id=3bed7bde1b98412b94a181719432cfa1 => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:25.320436 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d5da3-5cb5-4d36-8233-22dbaaca248e None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:25.474984 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27681097-f88a-4c3f-bd43-855ebb2328e5 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:25.506891 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:25.560878 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d5da3-5cb5-4d36-8233-22dbaaca248e None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:25.563801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b5a88-4a14-4ffb-b63a-cf29eeea1f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:25.564499 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b5a88-4a14-4ffb-b63a-cf29eeea1f17 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:25.564790 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b5a88-4a14-4ffb-b63a-cf29eeea1f17 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:25.565979 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b5a88-4a14-4ffb-b63a-cf29eeea1f17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:25.566848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b5a88-4a14-4ffb-b63a-cf29eeea1f17 None admin] RBAC: Adding query filter params (role.id=923dd61feaca45d0933a4601fb2c065b, scope.project.id=f26148acb7004ff78333b7b62586ed2e, user.id=44293b77272f4265bf2e4dd85cca6be9) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:25.567201 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b5a88-4a14-4ffb-b63a-cf29eeea1f17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:25.568656 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b5a88-4a14-4ffb-b63a-cf29eeea1f17 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:25.580451 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 47/96] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:25 2022] GET /identity/v3/role_assignments?user.id=44293b77272f4265bf2e4dd85cca6be9&scope.project.id=f26148acb7004ff78333b7b62586ed2e&role.id=923dd61feaca45d0933a4601fb2c065b => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:25.644344 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d7f9-defc-44f5-8dc2-ed64ff6e2acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:25.645437 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d7f9-defc-44f5-8dc2-ed64ff6e2acd None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:25.645937 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d7f9-defc-44f5-8dc2-ed64ff6e2acd None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:25.646415 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d7f9-defc-44f5-8dc2-ed64ff6e2acd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:25.647517 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d7f9-defc-44f5-8dc2-ed64ff6e2acd None admin] RBAC: Adding query filter params (role.id=5b22d10db4e647389fd8b36e1bc524fd, scope.project.id=f26148acb7004ff78333b7b62586ed2e, user.id=616e5238fb534043a0db27a9e7971c92) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:25.648058 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d7f9-defc-44f5-8dc2-ed64ff6e2acd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:25.649788 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d7f9-defc-44f5-8dc2-ed64ff6e2acd None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:25.660131 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 50/97] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:25 2022] GET /identity/v3/role_assignments?user.id=616e5238fb534043a0db27a9e7971c92&scope.project.id=f26148acb7004ff78333b7b62586ed2e&role.id=5b22d10db4e647389fd8b36e1bc524fd => generated 259 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:27.079198 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b97bfa-cfb2-4cdd-803a-c5b5c7644b65 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:27.079700 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b97bfa-cfb2-4cdd-803a-c5b5c7644b65 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:27.079808 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b97bfa-cfb2-4cdd-803a-c5b5c7644b65 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:27.081239 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 48/98] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:27.088455 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c1a05-bcd6-47c2-b029-c69230a84278 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:27.088870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c1a05-bcd6-47c2-b029-c69230a84278 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:27.089046 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c1a05-bcd6-47c2-b029-c69230a84278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:27.106786 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d1028-3ccb-4b3a-a722-829ac6056573 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:27.107433 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d1028-3ccb-4b3a-a722-829ac6056573 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:27.107906 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d1028-3ccb-4b3a-a722-829ac6056573 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:27.109559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 49/99] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:27.112110 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-6a3c1a05-bcd6-47c2-b029-c69230a84278 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:27.113329 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-6a3c1a05-bcd6-47c2-b029-c69230a84278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:27.115323 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fcd8e-8442-4b6a-a701-9da20623242b None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:27.115821 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fcd8e-8442-4b6a-a701-9da20623242b None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:27.116293 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fcd8e-8442-4b6a-a701-9da20623242b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:27.133921 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-376fcd8e-8442-4b6a-a701-9da20623242b None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:27.135534 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-376fcd8e-8442-4b6a-a701-9da20623242b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:27.210915 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 51/100] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:27.234969 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c1a05-bcd6-47c2-b029-c69230a84278 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:27.245087 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 50/101] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:27.307075 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fcd8e-8442-4b6a-a701-9da20623242b None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:27.339131 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:27.340780 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:27.401721 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c1a05-bcd6-47c2-b029-c69230a84278 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:27.425094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fcd8e-8442-4b6a-a701-9da20623242b None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:27.463064 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688334b-74e4-40eb-961f-a586d5eddacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:27.463880 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688334b-74e4-40eb-961f-a586d5eddacb None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:27.464177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688334b-74e4-40eb-961f-a586d5eddacb None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:27.464464 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688334b-74e4-40eb-961f-a586d5eddacb None admin] PATH_INFO: `/v3/roles/member` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:27.472702 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815d7ab-d959-483b-9b73-cb146f760b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:27.473520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815d7ab-d959-483b-9b73-cb146f760b85 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:27.473809 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815d7ab-d959-483b-9b73-cb146f760b85 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:27.474135 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815d7ab-d959-483b-9b73-cb146f760b85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:27.475563 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815d7ab-d959-483b-9b73-cb146f760b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:27.477022 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815d7ab-d959-483b-9b73-cb146f760b85 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:27.479888 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 51/102] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:27.485186 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815d7ab-d959-483b-9b73-cb146f760b85 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:27.488468 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688334b-74e4-40eb-961f-a586d5eddacb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-4688334b-74e4-40eb-961f-a586d5eddacb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:27.504212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:27.505080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:27.505829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:27.505829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:27.505829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:27.505829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:27.505829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:27.505829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:27.505829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:27.505829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:27.505829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:27.505829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:27.505829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:27.505829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:27.505829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 52/103] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:27.510890 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57806ef1-9c42-427f-9ece-ca44997553fa None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:27.510890 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57806ef1-9c42-427f-9ece-ca44997553fa None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:27.510890 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57806ef1-9c42-427f-9ece-ca44997553fa None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:27.510890 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 53/104] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:27.513488 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57806ef1-9c42-427f-9ece-ca44997553fa None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:27.614592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:27.627163 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815d7ab-d959-483b-9b73-cb146f760b85 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:27.678198 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf517094-e150-440a-b247-2e92b3cd882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:27.679241 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf517094-e150-440a-b247-2e92b3cd882a None admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:27.679728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf517094-e150-440a-b247-2e92b3cd882a None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:27.680198 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf517094-e150-440a-b247-2e92b3cd882a None admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:27.681188 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf517094-e150-440a-b247-2e92b3cd882a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:27.689153 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf517094-e150-440a-b247-2e92b3cd882a None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:27.723303 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57806ef1-9c42-427f-9ece-ca44997553fa None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:27.735923 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 52/105] 10.222.0.86 () {60 vars in 1141 bytes} [Fri Jul 15 16:24:27 2022] POST /identity/v3/projects => generated 302 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:24:27.737472 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc131b8e-5167-4f5b-b30e-5108a8aad462 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:27.737961 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc131b8e-5167-4f5b-b30e-5108a8aad462 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:27.738468 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc131b8e-5167-4f5b-b30e-5108a8aad462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:27.753972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:27.769493 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-dc131b8e-5167-4f5b-b30e-5108a8aad462 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:27.770600 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c588e-d5ad-4ce4-a81d-b30157987bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:27.771339 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c588e-d5ad-4ce4-a81d-b30157987bc4 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:27.771632 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c588e-d5ad-4ce4-a81d-b30157987bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:27.771915 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c588e-d5ad-4ce4-a81d-b30157987bc4 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:27.772716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c588e-d5ad-4ce4-a81d-b30157987bc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:27.773036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c588e-d5ad-4ce4-a81d-b30157987bc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:27.774594 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c588e-d5ad-4ce4-a81d-b30157987bc4 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:27.775979 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-dc131b8e-5167-4f5b-b30e-5108a8aad462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:27.788624 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 54/106] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:27.795056 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c588e-d5ad-4ce4-a81d-b30157987bc4 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:27.912123 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c588e-d5ad-4ce4-a81d-b30157987bc4 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:27.916201 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 53/107] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:27.950666 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a94f20-bba8-4bfe-a5e6-23544d028c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:27.951787 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a94f20-bba8-4bfe-a5e6-23544d028c34 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:27.952106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a94f20-bba8-4bfe-a5e6-23544d028c34 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:27.952515 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a94f20-bba8-4bfe-a5e6-23544d028c34 None admin] PATH_INFO: `/v3/users/616e5238fb534043a0db27a9e7971c92` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:27.953942 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a94f20-bba8-4bfe-a5e6-23544d028c34 None admin] RBAC: Authorizing `identity:get_user(user_id=616e5238fb534043a0db27a9e7971c92)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:27.955545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a94f20-bba8-4bfe-a5e6-23544d028c34 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:27.957334 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 55/108] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:27 2022] GET /identity/v3/users/616e5238fb534043a0db27a9e7971c92 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:27.960692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc131b8e-5167-4f5b-b30e-5108a8aad462 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:27.963087 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a94f20-bba8-4bfe-a5e6-23544d028c34 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:28.064825 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:28.118588 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a94f20-bba8-4bfe-a5e6-23544d028c34 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:28.159442 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:28.165828 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bcb67-e5e3-448a-ba97-75d3f8738c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:28.166975 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bcb67-e5e3-448a-ba97-75d3f8738c02 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:28.167430 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bcb67-e5e3-448a-ba97-75d3f8738c02 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:28.167942 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bcb67-e5e3-448a-ba97-75d3f8738c02 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:28.172303 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bcb67-e5e3-448a-ba97-75d3f8738c02 None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:28.174019 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bcb67-e5e3-448a-ba97-75d3f8738c02 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:28.181453 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 56/109] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:27 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:28.186088 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bcb67-e5e3-448a-ba97-75d3f8738c02 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:28.229371 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc131b8e-5167-4f5b-b30e-5108a8aad462 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:28.270073 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6e99a-7c5d-459c-85f9-01515a760708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:28.278889 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6e99a-7c5d-459c-85f9-01515a760708 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:28.278889 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6e99a-7c5d-459c-85f9-01515a760708 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:28.278889 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6e99a-7c5d-459c-85f9-01515a760708 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:28.285343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6e99a-7c5d-459c-85f9-01515a760708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-40f6e99a-7c5d-459c-85f9-01515a760708 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:28.293725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:28.294578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:28.299769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:28.299769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:28.299769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:28.299769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:28.299769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:28.299769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:28.299769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:28.299769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:28.299769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:28.299769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:28.299769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:28.299769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:28.299769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 54/110] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:28.300885 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6e99a-7c5d-459c-85f9-01515a760708 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:28.349012 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bcb67-e5e3-448a-ba97-75d3f8738c02 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:28.385780 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:28.402218 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8622b-1fc6-4af1-8a29-386e1475c583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:28.403491 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8622b-1fc6-4af1-8a29-386e1475c583 None admin] REQUEST_METHOD: `PUT` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:28.403981 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8622b-1fc6-4af1-8a29-386e1475c583 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:28.404567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8622b-1fc6-4af1-8a29-386e1475c583 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e/users/616e5238fb534043a0db27a9e7971c92/roles/3bed7bde1b98412b94a181719432cfa1` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:28.407697 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8622b-1fc6-4af1-8a29-386e1475c583 None admin] RBAC: Authorizing `identity:create_grant(project_id=f26148acb7004ff78333b7b62586ed2e, user_id=616e5238fb534043a0db27a9e7971c92, role_id=3bed7bde1b98412b94a181719432cfa1)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:28.409455 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8622b-1fc6-4af1-8a29-386e1475c583 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:28.415490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6e99a-7c5d-459c-85f9-01515a760708 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:28.443309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 57/111] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:24:28 2022] PUT /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e/users/616e5238fb534043a0db27a9e7971c92/roles/3bed7bde1b98412b94a181719432cfa1 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:24:28.445255 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:28.452492 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb9fec-0d4f-492b-8252-6dfa3d65d0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:28.453480 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb9fec-0d4f-492b-8252-6dfa3d65d0bb None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:28.453869 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb9fec-0d4f-492b-8252-6dfa3d65d0bb None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:28.454247 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb9fec-0d4f-492b-8252-6dfa3d65d0bb None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:28.455251 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb9fec-0d4f-492b-8252-6dfa3d65d0bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:28.455562 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb9fec-0d4f-492b-8252-6dfa3d65d0bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:28.457147 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb9fec-0d4f-492b-8252-6dfa3d65d0bb None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:28.468629 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 55/112] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:28.475010 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8622b-1fc6-4af1-8a29-386e1475c583 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:28.603372 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8622b-1fc6-4af1-8a29-386e1475c583 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:28.648630 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834f3f4-4d2d-439c-a04b-d496a9ced4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:28.649545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834f3f4-4d2d-439c-a04b-d496a9ced4eb None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:28.649861 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834f3f4-4d2d-439c-a04b-d496a9ced4eb None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:28.650141 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834f3f4-4d2d-439c-a04b-d496a9ced4eb None admin] PATH_INFO: `/v3/users/e8e7ff7a015f416eb438dbfcd2a8dc55` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:28.672385 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834f3f4-4d2d-439c-a04b-d496a9ced4eb None admin] RBAC: Authorizing `identity:get_user(user_id=e8e7ff7a015f416eb438dbfcd2a8dc55)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:28.673848 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834f3f4-4d2d-439c-a04b-d496a9ced4eb None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:28.675787 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 58/113] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:28 2022] GET /identity/v3/users/e8e7ff7a015f416eb438dbfcd2a8dc55 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:28.681246 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb9fec-0d4f-492b-8252-6dfa3d65d0bb None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:28.795004 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb9fec-0d4f-492b-8252-6dfa3d65d0bb None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:28.830964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98990a7b-09cb-4b87-b4a7-dab4f47ce28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:28.831624 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98990a7b-09cb-4b87-b4a7-dab4f47ce28a None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:28.832007 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98990a7b-09cb-4b87-b4a7-dab4f47ce28a None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:28.832292 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98990a7b-09cb-4b87-b4a7-dab4f47ce28a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:28.888596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dd047-a78e-410b-b8be-4068f7a6111e None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:28.888945 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dd047-a78e-410b-b8be-4068f7a6111e None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:28.889925 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dd047-a78e-410b-b8be-4068f7a6111e None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:28.892887 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 59/114] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:28.910983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5b9c8-0bc2-437d-a387-97beccba0ed5 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:28.911609 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5b9c8-0bc2-437d-a387-97beccba0ed5 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:28.912021 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5b9c8-0bc2-437d-a387-97beccba0ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:28.913265 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:28.930470 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98990a7b-09cb-4b87-b4a7-dab4f47ce28a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:28.932032 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98990a7b-09cb-4b87-b4a7-dab4f47ce28a None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:28.941387 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-5af5b9c8-0bc2-437d-a387-97beccba0ed5 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:28.943073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-5af5b9c8-0bc2-437d-a387-97beccba0ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:29.012960 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:29.054121 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 56/115] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:29.060225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98990a7b-09cb-4b87-b4a7-dab4f47ce28a None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:29.065058 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 60/116] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:29.100573 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5b9c8-0bc2-437d-a387-97beccba0ed5 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:29.167174 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:29.175662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98990a7b-09cb-4b87-b4a7-dab4f47ce28a None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:29.215596 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69f5cb-6937-4c6d-8dff-5ac375eb5b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:29.216597 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69f5cb-6937-4c6d-8dff-5ac375eb5b46 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:29.216891 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69f5cb-6937-4c6d-8dff-5ac375eb5b46 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:29.217173 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69f5cb-6937-4c6d-8dff-5ac375eb5b46 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:29.219142 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69f5cb-6937-4c6d-8dff-5ac375eb5b46 None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:29.220616 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69f5cb-6937-4c6d-8dff-5ac375eb5b46 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:29.222720 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 57/117] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:29 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:29.229392 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69f5cb-6937-4c6d-8dff-5ac375eb5b46 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:29.298075 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5b9c8-0bc2-437d-a387-97beccba0ed5 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:29.333728 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847038d-21ab-4de4-a8eb-b0de2cb10984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:29.334549 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847038d-21ab-4de4-a8eb-b0de2cb10984 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:29.334844 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847038d-21ab-4de4-a8eb-b0de2cb10984 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:29.335158 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847038d-21ab-4de4-a8eb-b0de2cb10984 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:29.346732 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847038d-21ab-4de4-a8eb-b0de2cb10984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-6847038d-21ab-4de4-a8eb-b0de2cb10984 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:29.355789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:29.356713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:29.357476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:29.357476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:29.357476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:29.357476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:29.357476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:29.357476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:29.357476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:29.357476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:29.357476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:29.357476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:29.357476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:24:29.357476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:29.357476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 61/118] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:24:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:24:29.358895 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8049d58-2c5c-443a-ac27-487a7d2cd325 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:29.363461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8049d58-2c5c-443a-ac27-487a7d2cd325 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:29.363781 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8049d58-2c5c-443a-ac27-487a7d2cd325 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:29.365473 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 62/119] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:29.367448 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8049d58-2c5c-443a-ac27-487a7d2cd325 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:29.426615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69f5cb-6937-4c6d-8dff-5ac375eb5b46 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:29.427221 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:29.502522 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420186c-2548-4154-b093-d5c7d8f40a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:29.503226 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420186c-2548-4154-b093-d5c7d8f40a78 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:29.503568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420186c-2548-4154-b093-d5c7d8f40a78 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:29.503862 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420186c-2548-4154-b093-d5c7d8f40a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:29.504708 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420186c-2548-4154-b093-d5c7d8f40a78 None admin] RBAC: Adding query filter params (role.id=4fc6ee9bb4ab47abbc8c2e53d38dfadc, scope.project.id=f26148acb7004ff78333b7b62586ed2e, user.id=e8e7ff7a015f416eb438dbfcd2a8dc55) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:29.505035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420186c-2548-4154-b093-d5c7d8f40a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:29.506499 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420186c-2548-4154-b093-d5c7d8f40a78 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:29.520411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 58/120] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:29 2022] GET /identity/v3/role_assignments?user.id=e8e7ff7a015f416eb438dbfcd2a8dc55&scope.project.id=f26148acb7004ff78333b7b62586ed2e&role.id=4fc6ee9bb4ab47abbc8c2e53d38dfadc => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:29.521715 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f35c1-6591-46c5-b622-77b092a02c3e None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:29.522019 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f35c1-6591-46c5-b622-77b092a02c3e None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:29.522310 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f35c1-6591-46c5-b622-77b092a02c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:29.545378 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-087f35c1-6591-46c5-b622-77b092a02c3e None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:29.547788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-087f35c1-6591-46c5-b622-77b092a02c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:29.564936 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8049d58-2c5c-443a-ac27-487a7d2cd325 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:29.570933 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:29.627860 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 59/121] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:29.630479 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d751-8659-4ed5-81b5-c572d25b1a55 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:29.631269 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d751-8659-4ed5-81b5-c572d25b1a55 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:29.631757 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d751-8659-4ed5-81b5-c572d25b1a55 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:29.633394 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 60/122] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:29.638535 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18e09b-fce7-41b4-8e5f-8e2ba2e10040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:29.639243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18e09b-fce7-41b4-8e5f-8e2ba2e10040 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:29.639575 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18e09b-fce7-41b4-8e5f-8e2ba2e10040 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:29.639862 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18e09b-fce7-41b4-8e5f-8e2ba2e10040 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:29.640166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb21047-0ba0-4d3d-b3cb-e7e7aeba1693 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:29.640633 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18e09b-fce7-41b4-8e5f-8e2ba2e10040 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:29.640952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18e09b-fce7-41b4-8e5f-8e2ba2e10040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:29.641101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb21047-0ba0-4d3d-b3cb-e7e7aeba1693 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:29.641639 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb21047-0ba0-4d3d-b3cb-e7e7aeba1693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:29.642351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18e09b-fce7-41b4-8e5f-8e2ba2e10040 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:29.662760 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-eeb21047-0ba0-4d3d-b3cb-e7e7aeba1693 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:29.664504 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-eeb21047-0ba0-4d3d-b3cb-e7e7aeba1693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:29.665480 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 63/123] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:24:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:29.666355 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18e09b-fce7-41b4-8e5f-8e2ba2e10040 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:29.796555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 61/124] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:29.797612 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb21047-0ba0-4d3d-b3cb-e7e7aeba1693 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:29.866988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:29.885638 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18e09b-fce7-41b4-8e5f-8e2ba2e10040 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:29.942654 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea1c85-0891-4908-ad4e-59a6242db4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:29.943491 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea1c85-0891-4908-ad4e-59a6242db4d0 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:29.943784 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea1c85-0891-4908-ad4e-59a6242db4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:29.944068 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea1c85-0891-4908-ad4e-59a6242db4d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:29.947216 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:29.964404 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea1c85-0891-4908-ad4e-59a6242db4d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-cbea1c85-0891-4908-ad4e-59a6242db4d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:29.972568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:29.973546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:29.974674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:29.974674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:29.974674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:29.974674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:29.974674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:29.974674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:29.974674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:29.974674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:29.974674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:29.974674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:29.974674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:29.974674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:29.974674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 64/125] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:29.974674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea1c85-0891-4908-ad4e-59a6242db4d0 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:29.983002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb21047-0ba0-4d3d-b3cb-e7e7aeba1693 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:30.049983 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9bd08-55a0-47fa-b659-ce183f021e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:30.050795 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9bd08-55a0-47fa-b659-ce183f021e28 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:30.051114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9bd08-55a0-47fa-b659-ce183f021e28 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:30.051406 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9bd08-55a0-47fa-b659-ce183f021e28 None admin] PATH_INFO: `/v3/users/616e5238fb534043a0db27a9e7971c92` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:30.054901 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9bd08-55a0-47fa-b659-ce183f021e28 None admin] RBAC: Authorizing `identity:get_user(user_id=616e5238fb534043a0db27a9e7971c92)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:30.054901 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9bd08-55a0-47fa-b659-ce183f021e28 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:30.055810 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 62/126] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:29 2022] GET /identity/v3/users/616e5238fb534043a0db27a9e7971c92 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:30.056583 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9bd08-55a0-47fa-b659-ce183f021e28 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:30.176974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea1c85-0891-4908-ad4e-59a6242db4d0 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:30.229030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9bd08-55a0-47fa-b659-ce183f021e28 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:30.242318 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0815f8a-d9e2-458b-8bc8-83b3b50f4057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:30.243147 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0815f8a-d9e2-458b-8bc8-83b3b50f4057 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:30.243443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0815f8a-d9e2-458b-8bc8-83b3b50f4057 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:30.243757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0815f8a-d9e2-458b-8bc8-83b3b50f4057 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:30.265419 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0815f8a-d9e2-458b-8bc8-83b3b50f4057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-a0815f8a-d9e2-458b-8bc8-83b3b50f4057 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:30.273224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:30.274084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:30.274851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:30.274851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:30.274851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:30.274851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:30.274851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:30.274851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:30.274851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:30.274851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:30.274851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:30.274851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:30.274851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:30.274851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:30.274851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 65/127] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:24:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:30.288161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0815f8a-d9e2-458b-8bc8-83b3b50f4057 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:30.305829 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12946e50-682b-4a90-a635-46498dc53177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:30.306606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12946e50-682b-4a90-a635-46498dc53177 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:30.306739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12946e50-682b-4a90-a635-46498dc53177 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:30.307019 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12946e50-682b-4a90-a635-46498dc53177 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:30.307777 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12946e50-682b-4a90-a635-46498dc53177 None admin] RBAC: Adding query filter params (name=member) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:30.308092 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12946e50-682b-4a90-a635-46498dc53177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:30.309481 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12946e50-682b-4a90-a635-46498dc53177 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:30.314618 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:30.336943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 63/128] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:30.337624 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12946e50-682b-4a90-a635-46498dc53177 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:30.379140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:30.408351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0815f8a-d9e2-458b-8bc8-83b3b50f4057 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:30.445290 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdffc1-fc7d-4b8a-b5de-af917b9a7583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:30.446603 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdffc1-fc7d-4b8a-b5de-af917b9a7583 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:30.447165 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdffc1-fc7d-4b8a-b5de-af917b9a7583 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:30.447675 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdffc1-fc7d-4b8a-b5de-af917b9a7583 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:30.449212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdffc1-fc7d-4b8a-b5de-af917b9a7583 None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:30.450917 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdffc1-fc7d-4b8a-b5de-af917b9a7583 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:30.453411 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 66/129] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:30 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:30.454419 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdffc1-fc7d-4b8a-b5de-af917b9a7583 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:30.551394 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12946e50-682b-4a90-a635-46498dc53177 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:30.595238 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9cad2-47b6-4898-8d47-449e6c5d4b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:30.595957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9cad2-47b6-4898-8d47-449e6c5d4b08 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:30.596260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9cad2-47b6-4898-8d47-449e6c5d4b08 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:30.596546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9cad2-47b6-4898-8d47-449e6c5d4b08 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:30.597312 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9cad2-47b6-4898-8d47-449e6c5d4b08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:30.597632 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9cad2-47b6-4898-8d47-449e6c5d4b08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:30.599062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9cad2-47b6-4898-8d47-449e6c5d4b08 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:30.616768 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 64/130] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:30.617624 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9cad2-47b6-4898-8d47-449e6c5d4b08 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:30.627229 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:30.654821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdffc1-fc7d-4b8a-b5de-af917b9a7583 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:30.731623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c5e9f-a551-45d1-8109-b267dd1238cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:30.732520 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c5e9f-a551-45d1-8109-b267dd1238cd None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:30.732812 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c5e9f-a551-45d1-8109-b267dd1238cd None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:30.733612 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c5e9f-a551-45d1-8109-b267dd1238cd None admin] PATH_INFO: `/v3/users/616e5238fb534043a0db27a9e7971c92` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:30.734890 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c5e9f-a551-45d1-8109-b267dd1238cd None admin] RBAC: Authorizing `identity:get_user(user_id=616e5238fb534043a0db27a9e7971c92)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:30.736348 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c5e9f-a551-45d1-8109-b267dd1238cd None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:30.738372 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 67/131] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:30 2022] GET /identity/v3/users/616e5238fb534043a0db27a9e7971c92 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:30.743730 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c5e9f-a551-45d1-8109-b267dd1238cd None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:30.763285 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:30.791186 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9cad2-47b6-4898-8d47-449e6c5d4b08 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:30.851163 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9530f2-d8ef-4860-abe2-df77a94eeb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:30.852248 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9530f2-d8ef-4860-abe2-df77a94eeb7f None admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:30.852542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9530f2-d8ef-4860-abe2-df77a94eeb7f None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:30.852829 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9530f2-d8ef-4860-abe2-df77a94eeb7f None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e/users/616e5238fb534043a0db27a9e7971c92/roles/5b22d10db4e647389fd8b36e1bc524fd` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:30.864875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9530f2-d8ef-4860-abe2-df77a94eeb7f None admin] RBAC: Authorizing `identity:create_grant(project_id=f26148acb7004ff78333b7b62586ed2e, user_id=616e5238fb534043a0db27a9e7971c92, role_id=5b22d10db4e647389fd8b36e1bc524fd)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:30.864875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9530f2-d8ef-4860-abe2-df77a94eeb7f None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:30.902214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c5e9f-a551-45d1-8109-b267dd1238cd None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:30.922322 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 65/132] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:24:30 2022] PUT /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e/users/616e5238fb534043a0db27a9e7971c92/roles/5b22d10db4e647389fd8b36e1bc524fd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:24:30.923387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9530f2-d8ef-4860-abe2-df77a94eeb7f None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:30.941196 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfa822-11dd-4173-acdb-aa93ecc8f94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:30.942496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfa822-11dd-4173-acdb-aa93ecc8f94b None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:30.943133 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfa822-11dd-4173-acdb-aa93ecc8f94b None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:30.943651 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfa822-11dd-4173-acdb-aa93ecc8f94b None admin] PATH_INFO: `/v3/users/44293b77272f4265bf2e4dd85cca6be9` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:30.945277 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfa822-11dd-4173-acdb-aa93ecc8f94b None admin] RBAC: Authorizing `identity:get_user(user_id=44293b77272f4265bf2e4dd85cca6be9)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:30.947081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfa822-11dd-4173-acdb-aa93ecc8f94b None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:30.948993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 68/133] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:30 2022] GET /identity/v3/users/44293b77272f4265bf2e4dd85cca6be9 => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:30.956231 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfa822-11dd-4173-acdb-aa93ecc8f94b None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:31.011274 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:31.136803 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9530f2-d8ef-4860-abe2-df77a94eeb7f None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:31.152642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfa822-11dd-4173-acdb-aa93ecc8f94b None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:31.193876 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd45b6-33d7-445a-9d2f-3fb41a4afd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:31.194806 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd45b6-33d7-445a-9d2f-3fb41a4afd80 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:31.195127 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd45b6-33d7-445a-9d2f-3fb41a4afd80 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:31.195409 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd45b6-33d7-445a-9d2f-3fb41a4afd80 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:31.196882 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd45b6-33d7-445a-9d2f-3fb41a4afd80 None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:31.198353 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd45b6-33d7-445a-9d2f-3fb41a4afd80 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:31.200375 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 69/134] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:30 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:31.204368 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b52e5-7106-408b-aee5-094e137b9bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:31.205281 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b52e5-7106-408b-aee5-094e137b9bb1 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:31.205575 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b52e5-7106-408b-aee5-094e137b9bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:31.206024 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b52e5-7106-408b-aee5-094e137b9bb1 None admin] PATH_INFO: `/v3/projects/d390fb5229214c68b3468da530829773` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:31.207116 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd45b6-33d7-445a-9d2f-3fb41a4afd80 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:31.207242 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b52e5-7106-408b-aee5-094e137b9bb1 None admin] RBAC: Authorizing `identity:get_project(project_id=d390fb5229214c68b3468da530829773)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:31.208636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b52e5-7106-408b-aee5-094e137b9bb1 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:31.210596 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 66/135] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:30 2022] GET /identity/v3/projects/d390fb5229214c68b3468da530829773 => generated 312 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:31.217261 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b52e5-7106-408b-aee5-094e137b9bb1 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:31.231897 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:31.339018 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:31.352760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd45b6-33d7-445a-9d2f-3fb41a4afd80 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:31.391409 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b52e5-7106-408b-aee5-094e137b9bb1 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:31.402356 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6984ab6-0764-4902-910f-be3b5569f9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:31.403753 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6984ab6-0764-4902-910f-be3b5569f9d2 None admin] REQUEST_METHOD: `PUT` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:31.404314 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6984ab6-0764-4902-910f-be3b5569f9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:31.404615 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6984ab6-0764-4902-910f-be3b5569f9d2 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e/users/44293b77272f4265bf2e4dd85cca6be9/roles/923dd61feaca45d0933a4601fb2c065b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:31.407485 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6984ab6-0764-4902-910f-be3b5569f9d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f26148acb7004ff78333b7b62586ed2e, user_id=44293b77272f4265bf2e4dd85cca6be9, role_id=923dd61feaca45d0933a4601fb2c065b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:31.409223 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6984ab6-0764-4902-910f-be3b5569f9d2 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:31.429766 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 70/136] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:24:31 2022] PUT /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e/users/44293b77272f4265bf2e4dd85cca6be9/roles/923dd61feaca45d0933a4601fb2c065b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 16:24:31.431371 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130711f7-6fe5-438a-aa5b-188f843b1018 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:31.431672 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130711f7-6fe5-438a-aa5b-188f843b1018 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:31.431964 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130711f7-6fe5-438a-aa5b-188f843b1018 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:31.433647 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 71/137] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:31.433924 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069410d7-e070-451b-8dfe-831b71d9144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:31.434789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932a3aa-6513-4736-b2ef-c763b3cd63a9 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:31.434949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069410d7-e070-451b-8dfe-831b71d9144c None admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:31.435203 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069410d7-e070-451b-8dfe-831b71d9144c None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:31.435493 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069410d7-e070-451b-8dfe-831b71d9144c None admin] PATH_INFO: `/v3/projects/d390fb5229214c68b3468da530829773/users/616e5238fb534043a0db27a9e7971c92/roles/3bed7bde1b98412b94a181719432cfa1` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:31.438244 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069410d7-e070-451b-8dfe-831b71d9144c None admin] RBAC: Authorizing `identity:create_grant(project_id=d390fb5229214c68b3468da530829773, user_id=616e5238fb534043a0db27a9e7971c92, role_id=3bed7bde1b98412b94a181719432cfa1)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:31.439863 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069410d7-e070-451b-8dfe-831b71d9144c None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:31.440071 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932a3aa-6513-4736-b2ef-c763b3cd63a9 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:31.440352 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932a3aa-6513-4736-b2ef-c763b3cd63a9 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:31.441879 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 72/138] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:31.443390 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63398b82-e6a3-4487-84d7-218fd87fcb1c None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:31.444155 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63398b82-e6a3-4487-84d7-218fd87fcb1c None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:31.444687 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63398b82-e6a3-4487-84d7-218fd87fcb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:31.457201 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 67/139] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:24:31 2022] PUT /identity/v3/projects/d390fb5229214c68b3468da530829773/users/616e5238fb534043a0db27a9e7971c92/roles/3bed7bde1b98412b94a181719432cfa1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 16:24:31.459756 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0365f7-2b7c-4c5b-b5e6-6064898f2a43 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:31.460415 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0365f7-2b7c-4c5b-b5e6-6064898f2a43 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:31.460714 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0365f7-2b7c-4c5b-b5e6-6064898f2a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:31.464376 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-63398b82-e6a3-4487-84d7-218fd87fcb1c None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:31.465737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-63398b82-e6a3-4487-84d7-218fd87fcb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:31.486178 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-9a0365f7-2b7c-4c5b-b5e6-6064898f2a43 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:31.487586 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-9a0365f7-2b7c-4c5b-b5e6-6064898f2a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:31.559910 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:31.570663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 68/140] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:31.581241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 73/141] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:31.620819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0365f7-2b7c-4c5b-b5e6-6064898f2a43 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:31.632458 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63398b82-e6a3-4487-84d7-218fd87fcb1c None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:31.741132 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:31.772017 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63398b82-e6a3-4487-84d7-218fd87fcb1c None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:31.805782 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0365f7-2b7c-4c5b-b5e6-6064898f2a43 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:31.821315 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285f277-d87b-4114-a98c-6c7166832ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:31.822530 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285f277-d87b-4114-a98c-6c7166832ee1 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:31.823063 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285f277-d87b-4114-a98c-6c7166832ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:31.823845 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285f277-d87b-4114-a98c-6c7166832ee1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:31.838301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285f277-d87b-4114-a98c-6c7166832ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:31.846041 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a9f94-b227-4d41-8a46-4f368c40acb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:31.847047 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a9f94-b227-4d41-8a46-4f368c40acb4 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:31.847420 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a9f94-b227-4d41-8a46-4f368c40acb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:31.847780 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a9f94-b227-4d41-8a46-4f368c40acb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-a285f277-d87b-4114-a98c-6c7166832ee1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:31.849013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:31.850044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:31.851052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:31.851052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:31.851052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:31.851052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:31.851052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:31.851052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:31.851052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:31.851052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:31.851052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:31.851052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:31.851052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:31.851052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:31.851791 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a9f94-b227-4d41-8a46-4f368c40acb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:31.852863 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a9f94-b227-4d41-8a46-4f368c40acb4 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:31.853401 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 74/142] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:31.855149 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 69/143] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:31.866162 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a9f94-b227-4d41-8a46-4f368c40acb4 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:31.867062 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285f277-d87b-4114-a98c-6c7166832ee1 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:31.990166 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285f277-d87b-4114-a98c-6c7166832ee1 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:32.015966 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:32.038685 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad87c52-e19f-4fb8-949c-32211ecfe26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:32.039753 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad87c52-e19f-4fb8-949c-32211ecfe26f None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:32.040255 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad87c52-e19f-4fb8-949c-32211ecfe26f None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:32.040743 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad87c52-e19f-4fb8-949c-32211ecfe26f None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:32.041661 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad87c52-e19f-4fb8-949c-32211ecfe26f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:32.043585 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad87c52-e19f-4fb8-949c-32211ecfe26f None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:32.055562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:32.107226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 75/144] 10.222.0.86 () {60 vars in 1132 bytes} [Fri Jul 15 16:24:31 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:24:32.134339 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a9f94-b227-4d41-8a46-4f368c40acb4 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:32.188091 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd092774-9416-40c3-89f3-88ac41204fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:32.189181 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd092774-9416-40c3-89f3-88ac41204fce None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:32.189673 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd092774-9416-40c3-89f3-88ac41204fce None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:32.190153 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd092774-9416-40c3-89f3-88ac41204fce None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:32.191167 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd092774-9416-40c3-89f3-88ac41204fce None admin] RBAC: Adding query filter params (name=member) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:32.191706 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd092774-9416-40c3-89f3-88ac41204fce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:32.193401 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd092774-9416-40c3-89f3-88ac41204fce None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:32.207223 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 70/145] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:32.212873 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad87c52-e19f-4fb8-949c-32211ecfe26f None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:32.331815 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad87c52-e19f-4fb8-949c-32211ecfe26f None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:32.368199 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a8bd7-6c5f-49e6-8de8-56e9e9c82fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:32.369884 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a8bd7-6c5f-49e6-8de8-56e9e9c82fb1 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:32.370371 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a8bd7-6c5f-49e6-8de8-56e9e9c82fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:32.370847 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a8bd7-6c5f-49e6-8de8-56e9e9c82fb1 None admin] PATH_INFO: `/v3/users/616e5238fb534043a0db27a9e7971c92` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:32.372331 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a8bd7-6c5f-49e6-8de8-56e9e9c82fb1 None admin] RBAC: Authorizing `identity:get_user(user_id=616e5238fb534043a0db27a9e7971c92)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:32.374642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a8bd7-6c5f-49e6-8de8-56e9e9c82fb1 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:32.376604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 76/146] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:32 2022] GET /identity/v3/users/616e5238fb534043a0db27a9e7971c92 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:32.383978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd092774-9416-40c3-89f3-88ac41204fce None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:32.500260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd092774-9416-40c3-89f3-88ac41204fce None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:32.529834 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:32.542335 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcbbef-6f16-49d9-8db2-376e72d856e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:32.543127 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcbbef-6f16-49d9-8db2-376e72d856e3 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:32.543529 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcbbef-6f16-49d9-8db2-376e72d856e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:32.545317 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcbbef-6f16-49d9-8db2-376e72d856e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:32.638464 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcbbef-6f16-49d9-8db2-376e72d856e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:32.639931 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcbbef-6f16-49d9-8db2-376e72d856e3 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:32.770155 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 71/147] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:32.771354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a8bd7-6c5f-49e6-8de8-56e9e9c82fb1 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:32.835331 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:32.878817 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a8bd7-6c5f-49e6-8de8-56e9e9c82fb1 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:32.918525 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061fefc-bd14-4209-beb1-fa3db545c2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:32.919331 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061fefc-bd14-4209-beb1-fa3db545c2b8 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:32.919616 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061fefc-bd14-4209-beb1-fa3db545c2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:32.919888 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061fefc-bd14-4209-beb1-fa3db545c2b8 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:32.923316 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061fefc-bd14-4209-beb1-fa3db545c2b8 None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:32.924767 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061fefc-bd14-4209-beb1-fa3db545c2b8 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:32.926721 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 77/148] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:32 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:32.932404 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcbbef-6f16-49d9-8db2-376e72d856e3 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:32.943068 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50e4b2-db1b-4c85-a0f2-d111a0e42195 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:32.943356 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50e4b2-db1b-4c85-a0f2-d111a0e42195 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:32.943638 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50e4b2-db1b-4c85-a0f2-d111a0e42195 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:32.945187 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 78/149] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:24:32.950485 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee931c1-7876-4d97-b2ae-f02ce611b247 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:32.950772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee931c1-7876-4d97-b2ae-f02ce611b247 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:32.951335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee931c1-7876-4d97-b2ae-f02ce611b247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:32.981007 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:32.984576 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-7ee931c1-7876-4d97-b2ae-f02ce611b247 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:32.985771 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-7ee931c1-7876-4d97-b2ae-f02ce611b247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:33.126531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 79/150] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:33.128222 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcbbef-6f16-49d9-8db2-376e72d856e3 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:33.163564 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee931c1-7876-4d97-b2ae-f02ce611b247 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:33.183384 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8718e8-60f1-4674-9e36-b9cc652e7869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:33.184054 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8718e8-60f1-4674-9e36-b9cc652e7869 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:33.184336 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8718e8-60f1-4674-9e36-b9cc652e7869 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:33.184628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8718e8-60f1-4674-9e36-b9cc652e7869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:33.185458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8718e8-60f1-4674-9e36-b9cc652e7869 None admin] RBAC: Adding query filter params (role.id=3bed7bde1b98412b94a181719432cfa1, scope.project.id=f26148acb7004ff78333b7b62586ed2e, user.id=616e5238fb534043a0db27a9e7971c92) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:33.185774 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8718e8-60f1-4674-9e36-b9cc652e7869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:33.193721 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8718e8-60f1-4674-9e36-b9cc652e7869 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:33.207055 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 72/151] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:32 2022] GET /identity/v3/role_assignments?user.id=616e5238fb534043a0db27a9e7971c92&scope.project.id=f26148acb7004ff78333b7b62586ed2e&role.id=3bed7bde1b98412b94a181719432cfa1 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:33.245918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:33.290477 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee931c1-7876-4d97-b2ae-f02ce611b247 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:33.327790 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041764cf-2b99-41de-a44b-9409be33ac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:33.328633 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041764cf-2b99-41de-a44b-9409be33ac85 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:33.328916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041764cf-2b99-41de-a44b-9409be33ac85 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:33.329190 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041764cf-2b99-41de-a44b-9409be33ac85 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:33.341393 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041764cf-2b99-41de-a44b-9409be33ac85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-041764cf-2b99-41de-a44b-9409be33ac85 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:33.349952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:33.350855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:33.351653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:33.351653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:33.351653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:33.351653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:33.351653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:33.351653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:33.351653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:33.351653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:33.351653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:33.351653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:33.351653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:33.351653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:33.351653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 80/152] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:24:33.359017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8718e8-60f1-4674-9e36-b9cc652e7869 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:33.463943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:33.477527 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8718e8-60f1-4674-9e36-b9cc652e7869 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:33.523975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af59f41-7c91-4f83-8a19-e4e94d40863a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:33.524670 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af59f41-7c91-4f83-8a19-e4e94d40863a None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:33.524960 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af59f41-7c91-4f83-8a19-e4e94d40863a None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:33.525246 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af59f41-7c91-4f83-8a19-e4e94d40863a None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:33.526434 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af59f41-7c91-4f83-8a19-e4e94d40863a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:33.526434 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af59f41-7c91-4f83-8a19-e4e94d40863a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:33.527719 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af59f41-7c91-4f83-8a19-e4e94d40863a None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:33.537824 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 73/153] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:33.543702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041764cf-2b99-41de-a44b-9409be33ac85 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:33.675029 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041764cf-2b99-41de-a44b-9409be33ac85 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:33.711230 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:33.715462 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea41a85-6d50-4fbe-8698-565334e048f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:33.716294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea41a85-6d50-4fbe-8698-565334e048f8 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:33.716867 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea41a85-6d50-4fbe-8698-565334e048f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:33.717149 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea41a85-6d50-4fbe-8698-565334e048f8 None admin] PATH_INFO: `/v3/users/e8e7ff7a015f416eb438dbfcd2a8dc55` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:33.719318 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea41a85-6d50-4fbe-8698-565334e048f8 None admin] RBAC: Authorizing `identity:get_user(user_id=e8e7ff7a015f416eb438dbfcd2a8dc55)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:33.721223 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea41a85-6d50-4fbe-8698-565334e048f8 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:33.727106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 81/154] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:33 2022] GET /identity/v3/users/e8e7ff7a015f416eb438dbfcd2a8dc55 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:33.728540 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af59f41-7c91-4f83-8a19-e4e94d40863a None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:33.852209 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af59f41-7c91-4f83-8a19-e4e94d40863a None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:33.909947 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dac4b-bbbc-4245-8c7d-1762d6a31ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:33.911208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dac4b-bbbc-4245-8c7d-1762d6a31ab2 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:33.911695 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dac4b-bbbc-4245-8c7d-1762d6a31ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:33.912168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dac4b-bbbc-4245-8c7d-1762d6a31ab2 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:33.913603 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dac4b-bbbc-4245-8c7d-1762d6a31ab2 None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:33.915341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dac4b-bbbc-4245-8c7d-1762d6a31ab2 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:33.917281 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 74/155] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:33 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:33.927952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea41a85-6d50-4fbe-8698-565334e048f8 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:34.053793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea41a85-6d50-4fbe-8698-565334e048f8 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:34.097926 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878f8b5-d557-46be-bb68-bb3eb709bfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:34.098905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878f8b5-d557-46be-bb68-bb3eb709bfd5 None admin] REQUEST_METHOD: `PUT` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:34.099230 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878f8b5-d557-46be-bb68-bb3eb709bfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:34.099511 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878f8b5-d557-46be-bb68-bb3eb709bfd5 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e/users/e8e7ff7a015f416eb438dbfcd2a8dc55/roles/4fc6ee9bb4ab47abbc8c2e53d38dfadc` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:34.101545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878f8b5-d557-46be-bb68-bb3eb709bfd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f26148acb7004ff78333b7b62586ed2e, user_id=e8e7ff7a015f416eb438dbfcd2a8dc55, role_id=4fc6ee9bb4ab47abbc8c2e53d38dfadc)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:34.104315 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878f8b5-d557-46be-bb68-bb3eb709bfd5 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:34.128942 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 82/156] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:24:33 2022] PUT /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e/users/e8e7ff7a015f416eb438dbfcd2a8dc55/roles/4fc6ee9bb4ab47abbc8c2e53d38dfadc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:24:34.618759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069447f-43a2-4e21-8aad-8ac40ac708f5 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:34.619780 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069447f-43a2-4e21-8aad-8ac40ac708f5 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:34.620288 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069447f-43a2-4e21-8aad-8ac40ac708f5 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:34.622051 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 75/157] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:34.628151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43fbf3-fd5b-4879-bd45-2017e3f87d1e None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:34.628983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43fbf3-fd5b-4879-bd45-2017e3f87d1e None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:34.629408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43fbf3-fd5b-4879-bd45-2017e3f87d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:34.651408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-4e43fbf3-fd5b-4879-bd45-2017e3f87d1e None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:34.652823 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-4e43fbf3-fd5b-4879-bd45-2017e3f87d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:34.710436 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:34.740847 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 83/158] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:34.780798 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069447f-43a2-4e21-8aad-8ac40ac708f5 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:34.815923 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:34.915932 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069447f-43a2-4e21-8aad-8ac40ac708f5 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:34.936607 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6145ef-b580-48dc-9215-389898482d77 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:34.937272 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6145ef-b580-48dc-9215-389898482d77 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:34.937824 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6145ef-b580-48dc-9215-389898482d77 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:34.939475 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 84/159] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:24:34.944718 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d693f82-0cd8-4dc6-ba04-ab70951dbe71 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:34.945252 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d693f82-0cd8-4dc6-ba04-ab70951dbe71 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:34.945738 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d693f82-0cd8-4dc6-ba04-ab70951dbe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:34.957169 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e08dd3-1e37-48e1-b1b9-e77ec304591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:34.957995 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e08dd3-1e37-48e1-b1b9-e77ec304591b None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:34.958286 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e08dd3-1e37-48e1-b1b9-e77ec304591b None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:34.958571 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e08dd3-1e37-48e1-b1b9-e77ec304591b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:34.970806 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e08dd3-1e37-48e1-b1b9-e77ec304591b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-c7e08dd3-1e37-48e1-b1b9-e77ec304591b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:34.979832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:34.980751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:34.981514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:34.981514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:34.981514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:34.981514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:34.981514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:34.981514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:34.981514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:34.981514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:34.981514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:34.981514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:34.981514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:24:34.981514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:34.983469 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-2d693f82-0cd8-4dc6-ba04-ab70951dbe71 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:34.984488 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 76/160] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:24:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:34.984813 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-2d693f82-0cd8-4dc6-ba04-ab70951dbe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:34.997024 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e08dd3-1e37-48e1-b1b9-e77ec304591b None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:35.106890 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 85/161] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:35.131350 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:35.144566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d693f82-0cd8-4dc6-ba04-ab70951dbe71 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:35.149119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e08dd3-1e37-48e1-b1b9-e77ec304591b None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:35.206501 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c55a99-4412-442f-8233-062b672dc2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:35.207210 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c55a99-4412-442f-8233-062b672dc2e2 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:35.207498 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c55a99-4412-442f-8233-062b672dc2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:35.207783 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c55a99-4412-442f-8233-062b672dc2e2 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:35.208546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c55a99-4412-442f-8233-062b672dc2e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:35.208858 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c55a99-4412-442f-8233-062b672dc2e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:35.210254 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c55a99-4412-442f-8233-062b672dc2e2 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:35.223966 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 77/162] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:24:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:35.244237 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c55a99-4412-442f-8233-062b672dc2e2 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:35.280708 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d693f82-0cd8-4dc6-ba04-ab70951dbe71 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:35.292577 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:35.350036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990c581-2dd5-42e1-aad6-d6dce6974266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:35.350841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990c581-2dd5-42e1-aad6-d6dce6974266 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:35.351149 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990c581-2dd5-42e1-aad6-d6dce6974266 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:35.351421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990c581-2dd5-42e1-aad6-d6dce6974266 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:35.374345 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990c581-2dd5-42e1-aad6-d6dce6974266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-4990c581-2dd5-42e1-aad6-d6dce6974266 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:35.382214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:35.383089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:35.383855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:35.383855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:35.383855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:35.383855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:35.383855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:35.383855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:35.383855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:35.383855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:35.383855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:35.383855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:35.383855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:35.383855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:35.384977 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 86/163] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:24:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:35.396150 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990c581-2dd5-42e1-aad6-d6dce6974266 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:35.464156 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c55a99-4412-442f-8233-062b672dc2e2 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:35.535563 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312ccad-7821-4fb3-bc49-2bd104ba6aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:35.536450 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312ccad-7821-4fb3-bc49-2bd104ba6aa1 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:35.536732 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312ccad-7821-4fb3-bc49-2bd104ba6aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:35.537006 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312ccad-7821-4fb3-bc49-2bd104ba6aa1 None admin] PATH_INFO: `/v3/users/616e5238fb534043a0db27a9e7971c92` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:35.539036 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312ccad-7821-4fb3-bc49-2bd104ba6aa1 None admin] RBAC: Authorizing `identity:get_user(user_id=616e5238fb534043a0db27a9e7971c92)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:35.540485 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312ccad-7821-4fb3-bc49-2bd104ba6aa1 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:35.542110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 78/164] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:35 2022] GET /identity/v3/users/616e5238fb534043a0db27a9e7971c92 => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:35.549913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312ccad-7821-4fb3-bc49-2bd104ba6aa1 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:35.571216 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:35.580801 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990c581-2dd5-42e1-aad6-d6dce6974266 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:35.662901 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312ccad-7821-4fb3-bc49-2bd104ba6aa1 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:35.698223 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff5306-309a-4b3b-a993-5969ebfa41e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:35.699250 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff5306-309a-4b3b-a993-5969ebfa41e5 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:35.699738 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff5306-309a-4b3b-a993-5969ebfa41e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:35.700209 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff5306-309a-4b3b-a993-5969ebfa41e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:35.721366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141dad0-1013-41ce-b1de-4cdc896b2455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:35.722048 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141dad0-1013-41ce-b1de-4cdc896b2455 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:35.722500 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141dad0-1013-41ce-b1de-4cdc896b2455 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:35.722946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141dad0-1013-41ce-b1de-4cdc896b2455 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:35.723844 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141dad0-1013-41ce-b1de-4cdc896b2455 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:35.724319 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141dad0-1013-41ce-b1de-4cdc896b2455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:35.725842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141dad0-1013-41ce-b1de-4cdc896b2455 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:35.753260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 87/165] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:35.754959 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22db09-d34d-413c-97a0-fe0d56682fd9 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:35.755403 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22db09-d34d-413c-97a0-fe0d56682fd9 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:35.755828 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22db09-d34d-413c-97a0-fe0d56682fd9 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:35.757722 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 88/166] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:35.762972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efb572-512a-40a1-ab88-5835964b648d None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:35.763459 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efb572-512a-40a1-ab88-5835964b648d None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:35.763883 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efb572-512a-40a1-ab88-5835964b648d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:35.776029 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff5306-309a-4b3b-a993-5969ebfa41e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:35.777823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff5306-309a-4b3b-a993-5969ebfa41e5 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:35.795286 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:35.803970 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-85efb572-512a-40a1-ab88-5835964b648d None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:35.805209 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-85efb572-512a-40a1-ab88-5835964b648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:35.879315 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:35.907343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 79/167] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:35.908420 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff5306-309a-4b3b-a993-5969ebfa41e5 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:35.956948 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 89/168] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:35.958030 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efb572-512a-40a1-ab88-5835964b648d None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:36.015776 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff5306-309a-4b3b-a993-5969ebfa41e5 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:36.032878 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:36.051196 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d875404-db72-41e3-b1fc-db67a98a258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:36.052318 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d875404-db72-41e3-b1fc-db67a98a258e None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:36.052741 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d875404-db72-41e3-b1fc-db67a98a258e None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:36.053156 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d875404-db72-41e3-b1fc-db67a98a258e None admin] PATH_INFO: `/v3/users/44293b77272f4265bf2e4dd85cca6be9` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:36.054513 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d875404-db72-41e3-b1fc-db67a98a258e None admin] RBAC: Authorizing `identity:get_user(user_id=44293b77272f4265bf2e4dd85cca6be9)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:36.056234 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d875404-db72-41e3-b1fc-db67a98a258e None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:36.058348 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 80/169] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:35 2022] GET /identity/v3/users/44293b77272f4265bf2e4dd85cca6be9 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:36.059658 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d875404-db72-41e3-b1fc-db67a98a258e None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:36.139779 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efb572-512a-40a1-ab88-5835964b648d None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:36.208606 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8391b-3e3e-40b7-b845-a04229c209bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:36.209400 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8391b-3e3e-40b7-b845-a04229c209bc None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:36.209689 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8391b-3e3e-40b7-b845-a04229c209bc None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:36.209972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8391b-3e3e-40b7-b845-a04229c209bc None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:36.215602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8391b-3e3e-40b7-b845-a04229c209bc None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:36.217066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8391b-3e3e-40b7-b845-a04229c209bc None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:36.220193 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 90/170] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:35 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:36.220826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8391b-3e3e-40b7-b845-a04229c209bc None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:36.249091 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d875404-db72-41e3-b1fc-db67a98a258e None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:36.251091 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:36.370854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd2db1-2a80-4728-a559-2cc5e0e7147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:36.371701 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd2db1-2a80-4728-a559-2cc5e0e7147c None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:36.371988 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd2db1-2a80-4728-a559-2cc5e0e7147c None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:36.372267 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd2db1-2a80-4728-a559-2cc5e0e7147c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:36.372798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8391b-3e3e-40b7-b845-a04229c209bc None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:36.403489 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd2db1-2a80-4728-a559-2cc5e0e7147c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-1dcd2db1-2a80-4728-a559-2cc5e0e7147c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:36.411898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:36.412759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:36.413543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:36.413543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:36.413543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:36.413543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:36.413543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:36.413543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:36.413543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:36.413543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:36.413543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:36.413543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:36.413543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:36.413543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:36.413543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 81/171] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:36.414260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd2db1-2a80-4728-a559-2cc5e0e7147c None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:36.454782 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfead5-b347-4a08-bac7-29c29fdf6e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:36.455515 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfead5-b347-4a08-bac7-29c29fdf6e96 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:36.455816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfead5-b347-4a08-bac7-29c29fdf6e96 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:36.456066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfead5-b347-4a08-bac7-29c29fdf6e96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:36.524976 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:36.574390 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfead5-b347-4a08-bac7-29c29fdf6e96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:36.575900 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfead5-b347-4a08-bac7-29c29fdf6e96 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:36.623615 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:36.740720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 91/172] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:36.741597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfead5-b347-4a08-bac7-29c29fdf6e96 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:36.749329 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd2db1-2a80-4728-a559-2cc5e0e7147c None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:36.854384 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84242da2-fc7a-4ff4-94a0-f162004db045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:36.855318 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84242da2-fc7a-4ff4-94a0-f162004db045 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:36.855749 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84242da2-fc7a-4ff4-94a0-f162004db045 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:36.856173 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84242da2-fc7a-4ff4-94a0-f162004db045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:36.857149 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84242da2-fc7a-4ff4-94a0-f162004db045 None admin] RBAC: Adding query filter params (role.id=5b22d10db4e647389fd8b36e1bc524fd, scope.project.id=f26148acb7004ff78333b7b62586ed2e, user.id=616e5238fb534043a0db27a9e7971c92) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:36.857627 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84242da2-fc7a-4ff4-94a0-f162004db045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:36.876512 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84242da2-fc7a-4ff4-94a0-f162004db045 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:36.887715 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 82/173] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:36 2022] GET /identity/v3/role_assignments?user.id=616e5238fb534043a0db27a9e7971c92&scope.project.id=f26148acb7004ff78333b7b62586ed2e&role.id=5b22d10db4e647389fd8b36e1bc524fd => generated 608 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:36.888752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84242da2-fc7a-4ff4-94a0-f162004db045 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:36.993524 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfead5-b347-4a08-bac7-29c29fdf6e96 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:37.047774 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:37.051735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84242da2-fc7a-4ff4-94a0-f162004db045 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:37.056613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:37.079320 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b04ea-2d18-4124-8d21-fb3e8f93848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:37.080004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b04ea-2d18-4124-8d21-fb3e8f93848e None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:37.080286 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b04ea-2d18-4124-8d21-fb3e8f93848e None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:37.080563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b04ea-2d18-4124-8d21-fb3e8f93848e None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:37.081319 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b04ea-2d18-4124-8d21-fb3e8f93848e None admin] RBAC: Adding query filter params (name=member) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:37.081725 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b04ea-2d18-4124-8d21-fb3e8f93848e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:37.083232 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b04ea-2d18-4124-8d21-fb3e8f93848e None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:37.102527 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 92/174] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:37.112748 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5f3b5-3139-493f-91b4-3a97e4df5828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:37.113403 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b04ea-2d18-4124-8d21-fb3e8f93848e None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:37.114106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5f3b5-3139-493f-91b4-3a97e4df5828 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:37.114495 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5f3b5-3139-493f-91b4-3a97e4df5828 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:37.115367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5f3b5-3139-493f-91b4-3a97e4df5828 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:37.119832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5f3b5-3139-493f-91b4-3a97e4df5828 None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:37.121498 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5f3b5-3139-493f-91b4-3a97e4df5828 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:37.123497 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 83/175] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:36 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:37.129911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5f3b5-3139-493f-91b4-3a97e4df5828 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:37.323628 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b04ea-2d18-4124-8d21-fb3e8f93848e None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:37.351685 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5f3b5-3139-493f-91b4-3a97e4df5828 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:37.385640 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d1058-ea88-4732-aaaf-846bf0bad578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:37.386451 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d1058-ea88-4732-aaaf-846bf0bad578 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:37.386737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d1058-ea88-4732-aaaf-846bf0bad578 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:37.387050 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d1058-ea88-4732-aaaf-846bf0bad578 None admin] PATH_INFO: `/v3/users/616e5238fb534043a0db27a9e7971c92` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:37.388265 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d1058-ea88-4732-aaaf-846bf0bad578 None admin] RBAC: Authorizing `identity:get_user(user_id=616e5238fb534043a0db27a9e7971c92)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:37.390267 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d1058-ea88-4732-aaaf-846bf0bad578 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:37.391950 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 93/176] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:37 2022] GET /identity/v3/users/616e5238fb534043a0db27a9e7971c92 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:37.393238 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6639bf1-753f-47ee-be77-3fca0650b3e5 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:37.393528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6639bf1-753f-47ee-be77-3fca0650b3e5 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:37.393809 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6639bf1-753f-47ee-be77-3fca0650b3e5 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:37.395066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 94/177] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:37.401766 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22308b79-29c1-468f-a561-5c27d93a385e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:37.402544 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22308b79-29c1-468f-a561-5c27d93a385e None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:37.402984 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22308b79-29c1-468f-a561-5c27d93a385e None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:37.403428 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22308b79-29c1-468f-a561-5c27d93a385e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:37.404377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22308b79-29c1-468f-a561-5c27d93a385e None admin] RBAC: Adding query filter params (role.id=923dd61feaca45d0933a4601fb2c065b, scope.project.id=f26148acb7004ff78333b7b62586ed2e, user.id=44293b77272f4265bf2e4dd85cca6be9) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:37.404861 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22308b79-29c1-468f-a561-5c27d93a385e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:37.408035 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97be6f4-9462-41d0-8eb0-167df0c3d339 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:37.408328 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97be6f4-9462-41d0-8eb0-167df0c3d339 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:37.408609 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97be6f4-9462-41d0-8eb0-167df0c3d339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:37.414020 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22308b79-29c1-468f-a561-5c27d93a385e None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:37.428559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 84/178] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:37 2022] GET /identity/v3/role_assignments?user.id=44293b77272f4265bf2e4dd85cca6be9&scope.project.id=f26148acb7004ff78333b7b62586ed2e&role.id=923dd61feaca45d0933a4601fb2c065b => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:37.430561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22308b79-29c1-468f-a561-5c27d93a385e None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:37.435932 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-c97be6f4-9462-41d0-8eb0-167df0c3d339 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:37.437257 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-c97be6f4-9462-41d0-8eb0-167df0c3d339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:37.488122 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:37.505294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:37.526953 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 95/179] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:37.528424 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440dad4-c6a8-41f5-8c1d-d8742dbe7a2d None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:37.528724 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440dad4-c6a8-41f5-8c1d-d8742dbe7a2d None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:37.529006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440dad4-c6a8-41f5-8c1d-d8742dbe7a2d None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:37.531080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 96/180] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:37.532227 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e93597-07af-4e98-89a6-0b8b700cbf92 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:37.532518 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e93597-07af-4e98-89a6-0b8b700cbf92 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:37.532797 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e93597-07af-4e98-89a6-0b8b700cbf92 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:37.534245 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 97/181] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:37.539550 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9b2a1-cc63-466e-a15e-efc7512226bd None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:37.539839 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9b2a1-cc63-466e-a15e-efc7512226bd None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:37.540125 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9b2a1-cc63-466e-a15e-efc7512226bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:37.562193 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-26e9b2a1-cc63-466e-a15e-efc7512226bd None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:37.563439 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-26e9b2a1-cc63-466e-a15e-efc7512226bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:37.595597 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22308b79-29c1-468f-a561-5c27d93a385e None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:37.636888 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a36d8-90c3-4026-b61e-f762245f79bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:37.637485 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a36d8-90c3-4026-b61e-f762245f79bc None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:37.637777 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a36d8-90c3-4026-b61e-f762245f79bc None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:37.638073 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a36d8-90c3-4026-b61e-f762245f79bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:37.651001 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 98/182] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:37.652310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb9248-f967-4ed9-a132-fa6ecfd26301 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:37.652607 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb9248-f967-4ed9-a132-fa6ecfd26301 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:37.652884 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb9248-f967-4ed9-a132-fa6ecfd26301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:37.678372 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-60cb9248-f967-4ed9-a132-fa6ecfd26301 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:37.681152 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-60cb9248-f967-4ed9-a132-fa6ecfd26301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:37.715065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a36d8-90c3-4026-b61e-f762245f79bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:37.716606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a36d8-90c3-4026-b61e-f762245f79bc None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:37.771701 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 99/183] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:37.772518 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb9248-f967-4ed9-a132-fa6ecfd26301 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:37.775648 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:37.824623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:37.851738 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 85/184] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:37.851738 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a36d8-90c3-4026-b61e-f762245f79bc None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:37.888352 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb9248-f967-4ed9-a132-fa6ecfd26301 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:37.923502 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37668eb8-ea51-41ca-96e7-aa6608a1621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:37.924309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37668eb8-ea51-41ca-96e7-aa6608a1621d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:37.924597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37668eb8-ea51-41ca-96e7-aa6608a1621d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:37.924873 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37668eb8-ea51-41ca-96e7-aa6608a1621d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:37.935150 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37668eb8-ea51-41ca-96e7-aa6608a1621d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-37668eb8-ea51-41ca-96e7-aa6608a1621d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:37.942903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:37.943841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:37.944610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:37.944610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:37.944610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:37.944610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:37.944610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:37.944610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:37.944610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:37.944610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:37.944610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:37.944610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:37.944610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:37.944610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:37.944610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 100/185] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:37.946182 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37668eb8-ea51-41ca-96e7-aa6608a1621d None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:37.955867 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a36d8-90c3-4026-b61e-f762245f79bc None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:37.990503 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323492a8-a493-451f-8e1f-9bec9105a91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:37.991336 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323492a8-a493-451f-8e1f-9bec9105a91e None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:37.991622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323492a8-a493-451f-8e1f-9bec9105a91e None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:37.991898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323492a8-a493-451f-8e1f-9bec9105a91e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:37.994101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:38.003185 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323492a8-a493-451f-8e1f-9bec9105a91e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-323492a8-a493-451f-8e1f-9bec9105a91e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:38.011212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:38.012168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:38.012936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:38.012936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:38.012936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:38.012936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:38.012936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:38.012936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:38.012936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:38.012936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:38.012936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:38.012936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:38.012936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:24:38.012936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:38.012936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 86/186] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:24:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:38.018373 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323492a8-a493-451f-8e1f-9bec9105a91e None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:38.048318 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37668eb8-ea51-41ca-96e7-aa6608a1621d None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:38.057062 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:38.082045 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b08cc-a67b-4d8f-8701-7247e339cb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:38.082827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b08cc-a67b-4d8f-8701-7247e339cb0c None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:38.083139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b08cc-a67b-4d8f-8701-7247e339cb0c None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:38.083414 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b08cc-a67b-4d8f-8701-7247e339cb0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:38.084584 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b08cc-a67b-4d8f-8701-7247e339cb0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:38.086021 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b08cc-a67b-4d8f-8701-7247e339cb0c None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:38.087668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 101/187] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:38.087668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680297d4-522a-4a5d-a043-4d81bc49d8f3 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:38.087668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680297d4-522a-4a5d-a043-4d81bc49d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:38.087668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680297d4-522a-4a5d-a043-4d81bc49d8f3 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:38.087668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 102/188] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:38.091251 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680297d4-522a-4a5d-a043-4d81bc49d8f3 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:38.120525 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323492a8-a493-451f-8e1f-9bec9105a91e None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:38.153557 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33f1c3-a617-4c46-8463-c22e77164873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:38.154340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33f1c3-a617-4c46-8463-c22e77164873 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:38.154625 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33f1c3-a617-4c46-8463-c22e77164873 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:38.155478 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33f1c3-a617-4c46-8463-c22e77164873 None admin] PATH_INFO: `/v3/projects/d390fb5229214c68b3468da530829773` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:38.156742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33f1c3-a617-4c46-8463-c22e77164873 None admin] RBAC: Authorizing `identity:get_project(project_id=d390fb5229214c68b3468da530829773)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:38.158182 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33f1c3-a617-4c46-8463-c22e77164873 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:38.159892 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 87/189] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:38 2022] GET /identity/v3/projects/d390fb5229214c68b3468da530829773 => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:38.160648 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33f1c3-a617-4c46-8463-c22e77164873 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:38.195520 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680297d4-522a-4a5d-a043-4d81bc49d8f3 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:38.226343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:38.232779 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7e058-7c67-4683-b838-a49dd819512a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:38.233472 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7e058-7c67-4683-b838-a49dd819512a None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:38.233755 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7e058-7c67-4683-b838-a49dd819512a None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:38.234034 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7e058-7c67-4683-b838-a49dd819512a None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:38.234780 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7e058-7c67-4683-b838-a49dd819512a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:38.235132 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7e058-7c67-4683-b838-a49dd819512a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:38.236497 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7e058-7c67-4683-b838-a49dd819512a None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:38.245261 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 103/190] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:38.246049 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7e058-7c67-4683-b838-a49dd819512a None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:38.268682 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33f1c3-a617-4c46-8463-c22e77164873 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:38.290930 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:38.301768 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb54be3-2f54-4a45-8e84-7e0dfc8fb80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:38.302435 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb54be3-2f54-4a45-8e84-7e0dfc8fb80f None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:38.302717 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb54be3-2f54-4a45-8e84-7e0dfc8fb80f None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:38.303023 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb54be3-2f54-4a45-8e84-7e0dfc8fb80f None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:38.303765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb54be3-2f54-4a45-8e84-7e0dfc8fb80f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:38.304073 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb54be3-2f54-4a45-8e84-7e0dfc8fb80f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:38.305453 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb54be3-2f54-4a45-8e84-7e0dfc8fb80f None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:38.313449 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 88/191] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:24:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:38.314607 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c41a85-8869-4254-b1b0-cb11c77be6d1 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:38.314910 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c41a85-8869-4254-b1b0-cb11c77be6d1 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:38.315191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c41a85-8869-4254-b1b0-cb11c77be6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:38.331464 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-08c41a85-8869-4254-b1b0-cb11c77be6d1 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:38.332640 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-08c41a85-8869-4254-b1b0-cb11c77be6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:38.353916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7e058-7c67-4683-b838-a49dd819512a None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:38.387316 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3f55d-5244-467a-afcf-e27ad4b7e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:38.387980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3f55d-5244-467a-afcf-e27ad4b7e55b None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:38.388266 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3f55d-5244-467a-afcf-e27ad4b7e55b None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:38.388544 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3f55d-5244-467a-afcf-e27ad4b7e55b None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:38.389846 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3f55d-5244-467a-afcf-e27ad4b7e55b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:38.391392 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3f55d-5244-467a-afcf-e27ad4b7e55b None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:38.398691 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 89/192] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:38.408131 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c41a85-8869-4254-b1b0-cb11c77be6d1 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:38.411297 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 104/193] 10.222.0.86 () {60 vars in 1132 bytes} [Fri Jul 15 16:24:38 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:24:38.412106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3f55d-5244-467a-afcf-e27ad4b7e55b None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:38.481078 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:38.531027 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c41a85-8869-4254-b1b0-cb11c77be6d1 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:38.534831 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:38.544003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3f55d-5244-467a-afcf-e27ad4b7e55b None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:38.572054 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e80df-c048-431e-9145-3c1a47284d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:38.572880 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e80df-c048-431e-9145-3c1a47284d72 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:38.572988 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e80df-c048-431e-9145-3c1a47284d72 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:38.573266 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e80df-c048-431e-9145-3c1a47284d72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:38.574121 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e80df-c048-431e-9145-3c1a47284d72 None admin] RBAC: Adding query filter params (role.id=3bed7bde1b98412b94a181719432cfa1, scope.project.id=d390fb5229214c68b3468da530829773, user.id=616e5238fb534043a0db27a9e7971c92) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:38.574417 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e80df-c048-431e-9145-3c1a47284d72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:38.575973 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e80df-c048-431e-9145-3c1a47284d72 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:38.581898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a7d4b-8a3b-47dc-a84c-b2db35fbead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:38.582788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 90/194] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:38 2022] GET /identity/v3/role_assignments?user.id=616e5238fb534043a0db27a9e7971c92&scope.project.id=d390fb5229214c68b3468da530829773&role.id=3bed7bde1b98412b94a181719432cfa1 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:38.582924 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a7d4b-8a3b-47dc-a84c-b2db35fbead2 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:38.583758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e80df-c048-431e-9145-3c1a47284d72 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:38.591375 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a7d4b-8a3b-47dc-a84c-b2db35fbead2 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:38.591675 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a7d4b-8a3b-47dc-a84c-b2db35fbead2 None admin] PATH_INFO: `/v3/users/c6e2d0a88bb945be8363d5e736bf715b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:38.611929 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a7d4b-8a3b-47dc-a84c-b2db35fbead2 None admin] RBAC: Authorizing `identity:get_user(user_id=c6e2d0a88bb945be8363d5e736bf715b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:38.613426 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a7d4b-8a3b-47dc-a84c-b2db35fbead2 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:38.615441 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 105/195] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:38 2022] GET /identity/v3/users/c6e2d0a88bb945be8363d5e736bf715b => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:38.621390 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a7d4b-8a3b-47dc-a84c-b2db35fbead2 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:38.741649 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e80df-c048-431e-9145-3c1a47284d72 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:38.757841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a7d4b-8a3b-47dc-a84c-b2db35fbead2 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:38.771888 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:38.798398 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6d0ce-f64d-4f08-adda-20245fc7cdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:38.799354 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6d0ce-f64d-4f08-adda-20245fc7cdc7 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:38.799644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6d0ce-f64d-4f08-adda-20245fc7cdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:38.799929 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6d0ce-f64d-4f08-adda-20245fc7cdc7 None admin] PATH_INFO: `/v3/users/c6e2d0a88bb945be8363d5e736bf715b` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:38.801190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6d0ce-f64d-4f08-adda-20245fc7cdc7 None admin] RBAC: Authorizing `identity:get_user(user_id=c6e2d0a88bb945be8363d5e736bf715b)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:38.802636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6d0ce-f64d-4f08-adda-20245fc7cdc7 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:38.807415 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc17ffc-6867-41c3-bf6f-a9fd6abf2283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:38.808747 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc17ffc-6867-41c3-bf6f-a9fd6abf2283 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:38.809017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 91/196] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:38 2022] GET /identity/v3/users/c6e2d0a88bb945be8363d5e736bf715b => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:38.809328 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc17ffc-6867-41c3-bf6f-a9fd6abf2283 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:38.809745 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc17ffc-6867-41c3-bf6f-a9fd6abf2283 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:38.809913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6d0ce-f64d-4f08-adda-20245fc7cdc7 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:38.823936 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc17ffc-6867-41c3-bf6f-a9fd6abf2283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-cfc17ffc-6867-41c3-bf6f-a9fd6abf2283 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:38.832112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:38.833177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:38.834111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:38.834111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:38.834111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:38.834111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:38.834111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:38.834111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:38.834111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:38.834111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:38.834111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:38.834111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:38.834111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:38.834111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:38.838192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 106/197] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:38.839113 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc17ffc-6867-41c3-bf6f-a9fd6abf2283 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:38.866217 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:38.957252 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6d0ce-f64d-4f08-adda-20245fc7cdc7 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:38.967043 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc17ffc-6867-41c3-bf6f-a9fd6abf2283 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:39.005200 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa9996-1d82-44f6-bf26-b94426c3606c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:39.005967 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9996-1d82-44f6-bf26-b94426c3606c None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:39.006329 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9996-1d82-44f6-bf26-b94426c3606c None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:39.006762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9996-1d82-44f6-bf26-b94426c3606c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:39.008128 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2d887-9d1c-41ae-8f5d-68ff5b114f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:39.008998 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2d887-9d1c-41ae-8f5d-68ff5b114f1c None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:39.009463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2d887-9d1c-41ae-8f5d-68ff5b114f1c None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:39.010213 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2d887-9d1c-41ae-8f5d-68ff5b114f1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:39.081687 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa9996-1d82-44f6-bf26-b94426c3606c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:39.083415 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa9996-1d82-44f6-bf26-b94426c3606c None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:39.091285 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:39.098157 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:39.107741 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2d887-9d1c-41ae-8f5d-68ff5b114f1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:39.110834 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2d887-9d1c-41ae-8f5d-68ff5b114f1c None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:39.201535 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 107/198] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:39.202719 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa9996-1d82-44f6-bf26-b94426c3606c None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:39.232187 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 92/199] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:39.237380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2d887-9d1c-41ae-8f5d-68ff5b114f1c None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:39.333254 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa9996-1d82-44f6-bf26-b94426c3606c None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:39.335965 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:39.353340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2d887-9d1c-41ae-8f5d-68ff5b114f1c None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:39.358957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:39.391407 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df389e-8a7f-4f7b-9ec7-cf09d363e26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:39.392272 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df389e-8a7f-4f7b-9ec7-cf09d363e26d None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:39.392558 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df389e-8a7f-4f7b-9ec7-cf09d363e26d None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:39.392833 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df389e-8a7f-4f7b-9ec7-cf09d363e26d None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:39.393600 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67950e7-7d63-43b4-9ccf-e6f11a49e813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:39.394033 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df389e-8a7f-4f7b-9ec7-cf09d363e26d None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:39.394717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67950e7-7d63-43b4-9ccf-e6f11a49e813 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:39.395225 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67950e7-7d63-43b4-9ccf-e6f11a49e813 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:39.395522 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df389e-8a7f-4f7b-9ec7-cf09d363e26d None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:39.395911 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67950e7-7d63-43b4-9ccf-e6f11a49e813 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:39.397013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67950e7-7d63-43b4-9ccf-e6f11a49e813 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:39.397533 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67950e7-7d63-43b4-9ccf-e6f11a49e813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:39.399118 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67950e7-7d63-43b4-9ccf-e6f11a49e813 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:39.402166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 93/200] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:39 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:39.403049 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df389e-8a7f-4f7b-9ec7-cf09d363e26d None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:39.410918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 108/201] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:39.412028 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67950e7-7d63-43b4-9ccf-e6f11a49e813 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:39.526653 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df389e-8a7f-4f7b-9ec7-cf09d363e26d None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:39.541946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67950e7-7d63-43b4-9ccf-e6f11a49e813 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:39.570381 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f212f1-fdc7-4d82-a218-3b2677ea8454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:39.572079 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f212f1-fdc7-4d82-a218-3b2677ea8454 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:39.572812 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f212f1-fdc7-4d82-a218-3b2677ea8454 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:39.573335 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f212f1-fdc7-4d82-a218-3b2677ea8454 None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:39.574679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f212f1-fdc7-4d82-a218-3b2677ea8454 None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:39.577296 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f212f1-fdc7-4d82-a218-3b2677ea8454 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:39.577435 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d934fcd-5192-44a0-9392-36328e4ad850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:39.578438 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d934fcd-5192-44a0-9392-36328e4ad850 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:39.579028 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d934fcd-5192-44a0-9392-36328e4ad850 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:39.579574 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d934fcd-5192-44a0-9392-36328e4ad850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:39.579951 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 94/202] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:39 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:39.580915 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d934fcd-5192-44a0-9392-36328e4ad850 None admin] RBAC: Adding query filter params (role.id=5b22d10db4e647389fd8b36e1bc524fd, scope.project.id=78bf28db88014ad38e46d572425a9c71, user.id=c6e2d0a88bb945be8363d5e736bf715b) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:39.581092 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f212f1-fdc7-4d82-a218-3b2677ea8454 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:39.581419 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d934fcd-5192-44a0-9392-36328e4ad850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:39.583112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d934fcd-5192-44a0-9392-36328e4ad850 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:39.590020 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 109/203] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:39 2022] GET /identity/v3/role_assignments?user.id=c6e2d0a88bb945be8363d5e736bf715b&scope.project.id=78bf28db88014ad38e46d572425a9c71&role.id=5b22d10db4e647389fd8b36e1bc524fd => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:39.596007 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d934fcd-5192-44a0-9392-36328e4ad850 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:39.610501 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:39.683366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:39.704704 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f212f1-fdc7-4d82-a218-3b2677ea8454 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:39.746444 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65b470-1dea-4be3-8026-f618b9c6ea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:39.748046 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65b470-1dea-4be3-8026-f618b9c6ea4a None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:39.748529 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65b470-1dea-4be3-8026-f618b9c6ea4a None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:39.749102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65b470-1dea-4be3-8026-f618b9c6ea4a None admin] PATH_INFO: `/v3/users/e8e7ff7a015f416eb438dbfcd2a8dc55` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:39.750676 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65b470-1dea-4be3-8026-f618b9c6ea4a None admin] RBAC: Authorizing `identity:get_user(user_id=e8e7ff7a015f416eb438dbfcd2a8dc55)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:39.752482 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65b470-1dea-4be3-8026-f618b9c6ea4a None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:39.754748 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 95/204] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:39 2022] GET /identity/v3/users/e8e7ff7a015f416eb438dbfcd2a8dc55 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:39.765146 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65b470-1dea-4be3-8026-f618b9c6ea4a None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:39.850220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d934fcd-5192-44a0-9392-36328e4ad850 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:39.885396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:39.906205 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65b470-1dea-4be3-8026-f618b9c6ea4a None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:39.912454 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb87fc4-4bce-469c-adf3-eebca1466c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:39.913449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb87fc4-4bce-469c-adf3-eebca1466c53 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:39.913936 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb87fc4-4bce-469c-adf3-eebca1466c53 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:39.914445 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb87fc4-4bce-469c-adf3-eebca1466c53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:39.915614 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb87fc4-4bce-469c-adf3-eebca1466c53 None admin] RBAC: Adding query filter params (role.id=923dd61feaca45d0933a4601fb2c065b, scope.project.id=78bf28db88014ad38e46d572425a9c71, user.id=c6e2d0a88bb945be8363d5e736bf715b) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:39.923060 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb87fc4-4bce-469c-adf3-eebca1466c53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:39.924782 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb87fc4-4bce-469c-adf3-eebca1466c53 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:39.937397 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 110/205] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:39 2022] GET /identity/v3/role_assignments?user.id=c6e2d0a88bb945be8363d5e736bf715b&scope.project.id=78bf28db88014ad38e46d572425a9c71&role.id=923dd61feaca45d0933a4601fb2c065b => generated 259 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:39.977380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784ac04-d08b-4be2-9b18-3404970f8e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:39.978483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784ac04-d08b-4be2-9b18-3404970f8e25 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:39.978995 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784ac04-d08b-4be2-9b18-3404970f8e25 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:39.979472 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784ac04-d08b-4be2-9b18-3404970f8e25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:40.070350 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784ac04-d08b-4be2-9b18-3404970f8e25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:40.072207 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784ac04-d08b-4be2-9b18-3404970f8e25 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:40.197866 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:40.213370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 96/206] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:40.219879 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb87fc4-4bce-469c-adf3-eebca1466c53 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:40.336682 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb87fc4-4bce-469c-adf3-eebca1466c53 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:40.338243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:40.372139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca4d09-5515-465c-af46-bdfde68b5115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:40.372989 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca4d09-5515-465c-af46-bdfde68b5115 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:40.373276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca4d09-5515-465c-af46-bdfde68b5115 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:40.374115 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca4d09-5515-465c-af46-bdfde68b5115 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:40.375354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca4d09-5515-465c-af46-bdfde68b5115 None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:40.376806 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca4d09-5515-465c-af46-bdfde68b5115 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:40.378545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 111/207] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:40 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:40.384653 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784ac04-d08b-4be2-9b18-3404970f8e25 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:40.506742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784ac04-d08b-4be2-9b18-3404970f8e25 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:40.544931 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8bb2e-8ccb-4e6d-bf3c-031c3031b541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:40.545765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8bb2e-8ccb-4e6d-bf3c-031c3031b541 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:40.546150 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8bb2e-8ccb-4e6d-bf3c-031c3031b541 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:40.546524 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8bb2e-8ccb-4e6d-bf3c-031c3031b541 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:40.547793 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8bb2e-8ccb-4e6d-bf3c-031c3031b541 None admin] RBAC: Adding query filter params (role.id=4fc6ee9bb4ab47abbc8c2e53d38dfadc, scope.project.id=f26148acb7004ff78333b7b62586ed2e, user.id=e8e7ff7a015f416eb438dbfcd2a8dc55) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:40.548226 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8bb2e-8ccb-4e6d-bf3c-031c3031b541 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:40.549787 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8bb2e-8ccb-4e6d-bf3c-031c3031b541 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:40.555959 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 97/208] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:40 2022] GET /identity/v3/role_assignments?user.id=e8e7ff7a015f416eb438dbfcd2a8dc55&scope.project.id=f26148acb7004ff78333b7b62586ed2e&role.id=4fc6ee9bb4ab47abbc8c2e53d38dfadc => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:41.222019 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a2666-eb6e-4003-81f1-2d98be66b96d None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:41.222524 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a2666-eb6e-4003-81f1-2d98be66b96d None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:41.222601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a2666-eb6e-4003-81f1-2d98be66b96d None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:41.224267 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 112/209] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:41.230489 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92fa07-8fc5-4b33-8cf7-1668ecc1caa6 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:41.230957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05f897-4f58-477b-aeae-775cff36290c None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:41.231056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92fa07-8fc5-4b33-8cf7-1668ecc1caa6 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:41.231127 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05f897-4f58-477b-aeae-775cff36290c None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:41.231194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92fa07-8fc5-4b33-8cf7-1668ecc1caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:41.231445 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05f897-4f58-477b-aeae-775cff36290c None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:41.233379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 113/210] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:41.243587 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465791d-afa5-4477-9206-ba88d7d7ff8f None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:41.243881 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465791d-afa5-4477-9206-ba88d7d7ff8f None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:41.244222 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465791d-afa5-4477-9206-ba88d7d7ff8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:41.253525 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-7b92fa07-8fc5-4b33-8cf7-1668ecc1caa6 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:41.254711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-7b92fa07-8fc5-4b33-8cf7-1668ecc1caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:41.262816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-2465791d-afa5-4477-9206-ba88d7d7ff8f None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:41.264017 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-2465791d-afa5-4477-9206-ba88d7d7ff8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:41.307805 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:41.332664 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 98/211] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:41.337312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 114/212] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:41.360206 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92fa07-8fc5-4b33-8cf7-1668ecc1caa6 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:41.363109 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465791d-afa5-4477-9206-ba88d7d7ff8f None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:41.474054 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92fa07-8fc5-4b33-8cf7-1668ecc1caa6 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:41.481072 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:41.486564 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465791d-afa5-4477-9206-ba88d7d7ff8f None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:41.511899 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f76ea-7076-46dd-a64c-e6e5030b8fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:41.512703 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f76ea-7076-46dd-a64c-e6e5030b8fcc None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:41.512990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f76ea-7076-46dd-a64c-e6e5030b8fcc None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:41.513268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f76ea-7076-46dd-a64c-e6e5030b8fcc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:41.514681 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f76ea-7076-46dd-a64c-e6e5030b8fcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:41.516039 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f76ea-7076-46dd-a64c-e6e5030b8fcc None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:41.517676 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 99/213] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:41.523521 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f76ea-7076-46dd-a64c-e6e5030b8fcc None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:41.531630 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74921d85-0763-4814-86f4-b81ce274bcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:41.532751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74921d85-0763-4814-86f4-b81ce274bcf6 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:41.533773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74921d85-0763-4814-86f4-b81ce274bcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:41.534249 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74921d85-0763-4814-86f4-b81ce274bcf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:41.550422 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74921d85-0763-4814-86f4-b81ce274bcf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-74921d85-0763-4814-86f4-b81ce274bcf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:41.561686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:41.562547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:41.563366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:41.563366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:41.563366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:41.563366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:41.563366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:41.563366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:41.563366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:41.563366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:41.563366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:41.563366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:41.563366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:41.563366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:41.565143 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 115/214] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:41.570174 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74921d85-0763-4814-86f4-b81ce274bcf6 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:41.590312 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:41.657525 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f76ea-7076-46dd-a64c-e6e5030b8fcc None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:41.684124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74921d85-0763-4814-86f4-b81ce274bcf6 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:41.700400 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2a523-f56a-44b1-83e6-1d62ae9d4b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:41.701454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2a523-f56a-44b1-83e6-1d62ae9d4b11 None admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:41.701668 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2a523-f56a-44b1-83e6-1d62ae9d4b11 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:41.701922 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2a523-f56a-44b1-83e6-1d62ae9d4b11 None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:41.702643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2a523-f56a-44b1-83e6-1d62ae9d4b11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:41.704354 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2a523-f56a-44b1-83e6-1d62ae9d4b11 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:41.729362 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f552f0b-9819-4a66-b2d1-3af7ad326631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:41.730355 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f552f0b-9819-4a66-b2d1-3af7ad326631 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:41.730845 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f552f0b-9819-4a66-b2d1-3af7ad326631 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:41.731354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f552f0b-9819-4a66-b2d1-3af7ad326631 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:41.732301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f552f0b-9819-4a66-b2d1-3af7ad326631 None admin] RBAC: Adding query filter params (name=member) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:41.733392 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f552f0b-9819-4a66-b2d1-3af7ad326631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:41.735034 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f552f0b-9819-4a66-b2d1-3af7ad326631 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:41.735274 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 100/215] 10.222.0.86 () {60 vars in 1132 bytes} [Fri Jul 15 16:24:41 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:24:41.745191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 116/216] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:41.752150 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2a523-f56a-44b1-83e6-1d62ae9d4b11 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:41.879685 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2a523-f56a-44b1-83e6-1d62ae9d4b11 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:41.890694 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:41.921241 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f87ae0-4439-4f4c-9c9e-05a58b129f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:41.922128 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f87ae0-4439-4f4c-9c9e-05a58b129f7e None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:41.922413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f87ae0-4439-4f4c-9c9e-05a58b129f7e None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:41.922690 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f87ae0-4439-4f4c-9c9e-05a58b129f7e None admin] PATH_INFO: `/v3/users/3e9cbf90ad1a41b0b9cb9e74e864b53c` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:41.938243 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f87ae0-4439-4f4c-9c9e-05a58b129f7e None admin] RBAC: Authorizing `identity:get_user(user_id=3e9cbf90ad1a41b0b9cb9e74e864b53c)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:41.939792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f87ae0-4439-4f4c-9c9e-05a58b129f7e None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:41.944716 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 101/217] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:41 2022] GET /identity/v3/users/3e9cbf90ad1a41b0b9cb9e74e864b53c => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:41.947590 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f552f0b-9819-4a66-b2d1-3af7ad326631 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:41.979850 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:42.072265 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f552f0b-9819-4a66-b2d1-3af7ad326631 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:42.112476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ca15b-6205-41db-a1f9-a9c7e6647c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:42.113496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ca15b-6205-41db-a1f9-a9c7e6647c79 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:42.113981 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ca15b-6205-41db-a1f9-a9c7e6647c79 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:42.114475 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ca15b-6205-41db-a1f9-a9c7e6647c79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:42.189240 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63505311-a7ac-43b6-a3c8-be767393f03d None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:42.189522 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63505311-a7ac-43b6-a3c8-be767393f03d None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:42.189808 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63505311-a7ac-43b6-a3c8-be767393f03d None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:42.191508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 102/218] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:24:42.196255 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ca15b-6205-41db-a1f9-a9c7e6647c79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:42.196742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed667d4-e09e-4261-b56d-f27ca0f213ca None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:42.197039 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed667d4-e09e-4261-b56d-f27ca0f213ca None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:42.197328 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed667d4-e09e-4261-b56d-f27ca0f213ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:42.197728 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ca15b-6205-41db-a1f9-a9c7e6647c79 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:42.214379 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-bed667d4-e09e-4261-b56d-f27ca0f213ca None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:42.215622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-bed667d4-e09e-4261-b56d-f27ca0f213ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:42.226399 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:42.296173 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 103/219] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:42.319701 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed667d4-e09e-4261-b56d-f27ca0f213ca None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:42.341026 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 117/220] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:42.347500 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ca15b-6205-41db-a1f9-a9c7e6647c79 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:42.484925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:42.491517 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed667d4-e09e-4261-b56d-f27ca0f213ca None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:42.501933 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ca15b-6205-41db-a1f9-a9c7e6647c79 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:42.531229 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f990c0-fb86-4a8c-9a4f-b2eb5c47e0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:42.532075 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f990c0-fb86-4a8c-9a4f-b2eb5c47e0a5 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:42.532363 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f990c0-fb86-4a8c-9a4f-b2eb5c47e0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:42.532648 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f990c0-fb86-4a8c-9a4f-b2eb5c47e0a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:42.545084 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f990c0-fb86-4a8c-9a4f-b2eb5c47e0a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-16f990c0-fb86-4a8c-9a4f-b2eb5c47e0a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:42.555268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:42.556158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:42.557369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:42.557369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:42.557369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:42.557369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:42.557369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:42.557369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:42.557369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:42.557369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:42.557369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:42.557369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:42.557369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:24:42.557369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:42.557369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 104/221] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:24:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:42.563173 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f990c0-fb86-4a8c-9a4f-b2eb5c47e0a5 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:42.569011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:42.591671 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c6eb8-0eeb-442a-8f62-91c672b1a86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:42.593046 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c6eb8-0eeb-442a-8f62-91c672b1a86d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:42.593528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c6eb8-0eeb-442a-8f62-91c672b1a86d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:42.594002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c6eb8-0eeb-442a-8f62-91c672b1a86d None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:42.596910 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c6eb8-0eeb-442a-8f62-91c672b1a86d None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:42.598883 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c6eb8-0eeb-442a-8f62-91c672b1a86d None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:42.600873 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 118/222] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:42 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:42.609287 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c6eb8-0eeb-442a-8f62-91c672b1a86d None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:42.670047 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f990c0-fb86-4a8c-9a4f-b2eb5c47e0a5 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:42.707247 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54327321-3b6c-40e0-bd12-7f32785d26be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:42.707929 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54327321-3b6c-40e0-bd12-7f32785d26be None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:42.708222 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54327321-3b6c-40e0-bd12-7f32785d26be None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:42.708505 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54327321-3b6c-40e0-bd12-7f32785d26be None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:42.709390 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54327321-3b6c-40e0-bd12-7f32785d26be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:42.709705 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54327321-3b6c-40e0-bd12-7f32785d26be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:42.711250 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54327321-3b6c-40e0-bd12-7f32785d26be None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:42.720372 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 105/223] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:24:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:42.721658 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11e077-3b1a-4586-aa00-24040947100a None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:42.721952 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11e077-3b1a-4586-aa00-24040947100a None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:42.722236 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11e077-3b1a-4586-aa00-24040947100a None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:42.728059 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 106/224] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:42.729138 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11e077-3b1a-4586-aa00-24040947100a None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:42.750924 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:42.801543 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c6eb8-0eeb-442a-8f62-91c672b1a86d None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:42.843200 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11e077-3b1a-4586-aa00-24040947100a None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:42.849659 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebc3c2-e296-4679-a05f-bb9789a0c88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:42.850509 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebc3c2-e296-4679-a05f-bb9789a0c88a None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:42.851339 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebc3c2-e296-4679-a05f-bb9789a0c88a None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:42.851771 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebc3c2-e296-4679-a05f-bb9789a0c88a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:42.853103 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebc3c2-e296-4679-a05f-bb9789a0c88a None admin] RBAC: Adding query filter params (role.id=3bed7bde1b98412b94a181719432cfa1, scope.project.id=78bf28db88014ad38e46d572425a9c71, user.id=3e9cbf90ad1a41b0b9cb9e74e864b53c) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:42.853592 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebc3c2-e296-4679-a05f-bb9789a0c88a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:42.855798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebc3c2-e296-4679-a05f-bb9789a0c88a None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:42.862531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 119/225] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:42 2022] GET /identity/v3/role_assignments?user.id=3e9cbf90ad1a41b0b9cb9e74e864b53c&scope.project.id=78bf28db88014ad38e46d572425a9c71&role.id=3bed7bde1b98412b94a181719432cfa1 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:42.864228 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a6e87-d7ae-4c98-8847-68832d021a8f None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:42.864724 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a6e87-d7ae-4c98-8847-68832d021a8f None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:42.865223 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a6e87-d7ae-4c98-8847-68832d021a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:42.887695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-477a6e87-d7ae-4c98-8847-68832d021a8f None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:42.890086 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-477a6e87-d7ae-4c98-8847-68832d021a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:42.893571 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cddc4-8b5f-41c8-8c7f-a6f57853e96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:42.894850 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cddc4-8b5f-41c8-8c7f-a6f57853e96f None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:42.894850 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cddc4-8b5f-41c8-8c7f-a6f57853e96f None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:42.895038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cddc4-8b5f-41c8-8c7f-a6f57853e96f None admin] PATH_INFO: `/v3/users/c6e2d0a88bb945be8363d5e736bf715b` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:42.896386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cddc4-8b5f-41c8-8c7f-a6f57853e96f None admin] RBAC: Authorizing `identity:get_user(user_id=c6e2d0a88bb945be8363d5e736bf715b)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:42.897894 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cddc4-8b5f-41c8-8c7f-a6f57853e96f None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:42.899722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 107/226] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:42 2022] GET /identity/v3/users/c6e2d0a88bb945be8363d5e736bf715b => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:42.905823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cddc4-8b5f-41c8-8c7f-a6f57853e96f None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:42.960508 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:42.989987 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 120/227] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:43.005577 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:43.021150 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a6e87-d7ae-4c98-8847-68832d021a8f None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:43.023831 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cddc4-8b5f-41c8-8c7f-a6f57853e96f None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:43.094038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057a458-ccac-4d63-bf9d-cb67ea901f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:43.094837 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057a458-ccac-4d63-bf9d-cb67ea901f6e None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:43.095153 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057a458-ccac-4d63-bf9d-cb67ea901f6e None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:43.095434 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057a458-ccac-4d63-bf9d-cb67ea901f6e None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:43.098146 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057a458-ccac-4d63-bf9d-cb67ea901f6e None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:43.099638 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057a458-ccac-4d63-bf9d-cb67ea901f6e None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:43.101672 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 108/228] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:42 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:43.107589 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057a458-ccac-4d63-bf9d-cb67ea901f6e None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:43.141859 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a6e87-d7ae-4c98-8847-68832d021a8f None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:43.184755 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7079f-7fe5-43b0-8b57-e53b31a664f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:43.186362 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7079f-7fe5-43b0-8b57-e53b31a664f2 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:43.186855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7079f-7fe5-43b0-8b57-e53b31a664f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:43.187378 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7079f-7fe5-43b0-8b57-e53b31a664f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:43.200657 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7079f-7fe5-43b0-8b57-e53b31a664f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-c6a7079f-7fe5-43b0-8b57-e53b31a664f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:43.210523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:43.212275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:43.213170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:43.213170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:43.213170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:43.213170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:43.213170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:43.213170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:43.213170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:43.213170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:43.213170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:43.213170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:43.213170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:43.213170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:43.215114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 121/229] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:24:43.222609 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7079f-7fe5-43b0-8b57-e53b31a664f2 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:43.290952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:43.318598 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057a458-ccac-4d63-bf9d-cb67ea901f6e None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:43.382979 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7079f-7fe5-43b0-8b57-e53b31a664f2 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:43.394252 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5456976-9238-45d0-969b-76b48e2070ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:43.395398 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5456976-9238-45d0-969b-76b48e2070ec None admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:43.395688 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5456976-9238-45d0-969b-76b48e2070ec None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:43.395971 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5456976-9238-45d0-969b-76b48e2070ec None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71/users/c6e2d0a88bb945be8363d5e736bf715b/roles/5b22d10db4e647389fd8b36e1bc524fd` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:43.400246 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5456976-9238-45d0-969b-76b48e2070ec None admin] RBAC: Authorizing `identity:create_grant(project_id=78bf28db88014ad38e46d572425a9c71, user_id=c6e2d0a88bb945be8363d5e736bf715b, role_id=5b22d10db4e647389fd8b36e1bc524fd)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:43.401743 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5456976-9238-45d0-969b-76b48e2070ec None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:43.430588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 109/230] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:24:43 2022] PUT /identity/v3/projects/78bf28db88014ad38e46d572425a9c71/users/c6e2d0a88bb945be8363d5e736bf715b/roles/5b22d10db4e647389fd8b36e1bc524fd => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 16:24:43.447323 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00310d13-579b-4937-bdca-56a445912941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:43.448009 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310d13-579b-4937-bdca-56a445912941 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:43.448296 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310d13-579b-4937-bdca-56a445912941 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:43.448578 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310d13-579b-4937-bdca-56a445912941 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:43.449438 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00310d13-579b-4937-bdca-56a445912941 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:43.449754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00310d13-579b-4937-bdca-56a445912941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:43.452024 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00310d13-579b-4937-bdca-56a445912941 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:43.465734 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 122/231] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:43.472626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5456976-9238-45d0-969b-76b48e2070ec None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:43.496252 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:43.621053 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5456976-9238-45d0-969b-76b48e2070ec None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:43.693187 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb3679-665a-4e02-83ef-02b297ccf7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:43.694104 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb3679-665a-4e02-83ef-02b297ccf7a8 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:43.694393 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb3679-665a-4e02-83ef-02b297ccf7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:43.694674 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb3679-665a-4e02-83ef-02b297ccf7a8 None admin] PATH_INFO: `/v3/users/c6e2d0a88bb945be8363d5e736bf715b` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:43.703780 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb3679-665a-4e02-83ef-02b297ccf7a8 None admin] RBAC: Authorizing `identity:get_user(user_id=c6e2d0a88bb945be8363d5e736bf715b)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:43.705287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb3679-665a-4e02-83ef-02b297ccf7a8 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:43.707106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 110/232] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:43 2022] GET /identity/v3/users/c6e2d0a88bb945be8363d5e736bf715b => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:43.716256 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00310d13-579b-4937-bdca-56a445912941 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:43.884150 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00310d13-579b-4937-bdca-56a445912941 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:43.893361 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:43.944553 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6d5a7-ffec-4078-8a51-bf741573a0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:43.945350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6d5a7-ffec-4078-8a51-bf741573a0a1 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:43.945634 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6d5a7-ffec-4078-8a51-bf741573a0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:43.945912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6d5a7-ffec-4078-8a51-bf741573a0a1 None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:43.950360 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6d5a7-ffec-4078-8a51-bf741573a0a1 None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:43.952175 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6d5a7-ffec-4078-8a51-bf741573a0a1 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:43.954109 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 123/233] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:43 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:43.960066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb3679-665a-4e02-83ef-02b297ccf7a8 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:44.117419 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:44.145315 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb3679-665a-4e02-83ef-02b297ccf7a8 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:44.225570 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d7bc0-3aad-4061-ae66-4519659a776c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:44.227622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d7bc0-3aad-4061-ae66-4519659a776c None admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:44.227904 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d7bc0-3aad-4061-ae66-4519659a776c None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:44.228180 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d7bc0-3aad-4061-ae66-4519659a776c None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71/users/c6e2d0a88bb945be8363d5e736bf715b/roles/923dd61feaca45d0933a4601fb2c065b` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:44.230215 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d7bc0-3aad-4061-ae66-4519659a776c None admin] RBAC: Authorizing `identity:create_grant(project_id=78bf28db88014ad38e46d572425a9c71, user_id=c6e2d0a88bb945be8363d5e736bf715b, role_id=923dd61feaca45d0933a4601fb2c065b)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:44.232449 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d7bc0-3aad-4061-ae66-4519659a776c None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:44.255174 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 111/234] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:24:43 2022] PUT /identity/v3/projects/78bf28db88014ad38e46d572425a9c71/users/c6e2d0a88bb945be8363d5e736bf715b/roles/923dd61feaca45d0933a4601fb2c065b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:24:44.627550 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87182711-4739-4188-a731-601067346f60 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:44.628033 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87182711-4739-4188-a731-601067346f60 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:44.628033 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87182711-4739-4188-a731-601067346f60 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:44.629648 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 124/235] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:44.634658 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b7de2-7a37-4d34-96a8-0e5fce470123 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:44.635081 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b7de2-7a37-4d34-96a8-0e5fce470123 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:44.635249 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b7de2-7a37-4d34-96a8-0e5fce470123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:44.662798 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-1b7b7de2-7a37-4d34-96a8-0e5fce470123 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:44.664027 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-1b7b7de2-7a37-4d34-96a8-0e5fce470123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:44.766006 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 112/236] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:44.802431 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87182711-4739-4188-a731-601067346f60 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:44.897817 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc377f-75ca-4359-a646-1d5e087f7d9a None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:44.898310 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc377f-75ca-4359-a646-1d5e087f7d9a None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:44.898599 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc377f-75ca-4359-a646-1d5e087f7d9a None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:44.900249 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 113/237] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:44.907277 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5f4e2-1008-4130-a50e-e03f8a29fb1f None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:44.908439 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5f4e2-1008-4130-a50e-e03f8a29fb1f None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:44.908736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5f4e2-1008-4130-a50e-e03f8a29fb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:44.937099 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-eae5f4e2-1008-4130-a50e-e03f8a29fb1f None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:44.938296 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-eae5f4e2-1008-4130-a50e-e03f8a29fb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:44.962233 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87182711-4739-4188-a731-601067346f60 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:45.011427 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a527cd-53a7-4110-89bf-29bcd3448632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:45.012278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a527cd-53a7-4110-89bf-29bcd3448632 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:45.012566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a527cd-53a7-4110-89bf-29bcd3448632 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:45.012894 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a527cd-53a7-4110-89bf-29bcd3448632 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:45.025136 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a527cd-53a7-4110-89bf-29bcd3448632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-d3a527cd-53a7-4110-89bf-29bcd3448632 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:45.033864 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:45.034751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:45.035566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:45.035566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:45.035566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:45.035566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:45.035566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:45.035566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:45.035566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:45.035566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:45.035566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:45.035566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:45.035566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:45.035566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:45.035566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 125/238] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:45.040947 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a527cd-53a7-4110-89bf-29bcd3448632 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:45.069099 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 114/239] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:45.091299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:45.141712 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5f4e2-1008-4130-a50e-e03f8a29fb1f None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:45.157430 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:45.173699 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a527cd-53a7-4110-89bf-29bcd3448632 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:45.210691 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae12600-1d56-4720-be0c-b6941a4e69bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:45.211398 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae12600-1d56-4720-be0c-b6941a4e69bb None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:45.211681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae12600-1d56-4720-be0c-b6941a4e69bb None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:45.211958 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae12600-1d56-4720-be0c-b6941a4e69bb None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:45.212707 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae12600-1d56-4720-be0c-b6941a4e69bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:45.213014 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae12600-1d56-4720-be0c-b6941a4e69bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:45.214387 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae12600-1d56-4720-be0c-b6941a4e69bb None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:45.223772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 126/240] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:45.229580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae12600-1d56-4720-be0c-b6941a4e69bb None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:45.348128 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:45.355611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae12600-1d56-4720-be0c-b6941a4e69bb None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:45.393282 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff687e8-63d7-4388-b8f0-d1eb945ded03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:45.394264 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff687e8-63d7-4388-b8f0-d1eb945ded03 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:45.394638 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff687e8-63d7-4388-b8f0-d1eb945ded03 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:45.395011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff687e8-63d7-4388-b8f0-d1eb945ded03 None admin] PATH_INFO: `/v3/users/16394eb5a1d24cdfb40754b462f0b85d` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:45.409399 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff687e8-63d7-4388-b8f0-d1eb945ded03 None admin] RBAC: Authorizing `identity:get_user(user_id=16394eb5a1d24cdfb40754b462f0b85d)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:45.410981 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff687e8-63d7-4388-b8f0-d1eb945ded03 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:45.412768 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 127/241] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:45 2022] GET /identity/v3/users/16394eb5a1d24cdfb40754b462f0b85d => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:45.418252 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff687e8-63d7-4388-b8f0-d1eb945ded03 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:45.420867 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5f4e2-1008-4130-a50e-e03f8a29fb1f None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:45.530247 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff687e8-63d7-4388-b8f0-d1eb945ded03 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:45.559589 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993b7b1-7ed3-45f9-b70e-4f24b751e70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:45.560407 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993b7b1-7ed3-45f9-b70e-4f24b751e70d None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:45.560689 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993b7b1-7ed3-45f9-b70e-4f24b751e70d None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:45.561530 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993b7b1-7ed3-45f9-b70e-4f24b751e70d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:45.564742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993b7b1-7ed3-45f9-b70e-4f24b751e70d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:45.566447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993b7b1-7ed3-45f9-b70e-4f24b751e70d None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:45.566968 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c18d72-537a-4950-a929-ba996fb18b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:45.567690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c18d72-537a-4950-a929-ba996fb18b2c None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:45.568060 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c18d72-537a-4950-a929-ba996fb18b2c None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:45.568407 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c18d72-537a-4950-a929-ba996fb18b2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:45.568508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 115/242] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:45.575798 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993b7b1-7ed3-45f9-b70e-4f24b751e70d None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:45.615242 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:45.645157 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c18d72-537a-4950-a929-ba996fb18b2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:45.646615 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c18d72-537a-4950-a929-ba996fb18b2c None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:45.757601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 128/243] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 16:24:45.764150 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c18d72-537a-4950-a929-ba996fb18b2c None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:45.803486 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:45.831234 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:45.866569 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993b7b1-7ed3-45f9-b70e-4f24b751e70d None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:45.879226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c18d72-537a-4950-a929-ba996fb18b2c None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:45.914967 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5277b-f78a-44d9-a771-f72907c18bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:45.916086 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5277b-f78a-44d9-a771-f72907c18bdb None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:45.916523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5277b-f78a-44d9-a771-f72907c18bdb None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:45.916988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5277b-f78a-44d9-a771-f72907c18bdb None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:45.918424 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5277b-f78a-44d9-a771-f72907c18bdb None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:45.920068 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5277b-f78a-44d9-a771-f72907c18bdb None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:45.922467 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 129/244] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:45 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:45.928549 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5277b-f78a-44d9-a771-f72907c18bdb None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:45.944179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056cb1a-917a-4eb8-bc6b-9c7ac923e039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:45.944892 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056cb1a-917a-4eb8-bc6b-9c7ac923e039 None admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:45.945181 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056cb1a-917a-4eb8-bc6b-9c7ac923e039 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:45.945462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056cb1a-917a-4eb8-bc6b-9c7ac923e039 None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:45.946237 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056cb1a-917a-4eb8-bc6b-9c7ac923e039 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:45.948176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056cb1a-917a-4eb8-bc6b-9c7ac923e039 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:45.974268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 116/245] 10.222.0.86 () {60 vars in 1132 bytes} [Fri Jul 15 16:24:45 2022] POST /identity/v3/users => generated 293 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:24:45.981657 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50251e8-1cb8-4e61-ab25-7774885eb98a None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:45.983683 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50251e8-1cb8-4e61-ab25-7774885eb98a None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:45.984758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50251e8-1cb8-4e61-ab25-7774885eb98a None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:45.987307 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 117/246] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:45 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:45.993276 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae8b3-e542-407a-a326-556058781037 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:45.993866 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae8b3-e542-407a-a326-556058781037 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:45.994320 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae8b3-e542-407a-a326-556058781037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:46.027314 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-23dae8b3-e542-407a-a326-556058781037 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:46.030761 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-23dae8b3-e542-407a-a326-556058781037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:46.105970 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5277b-f78a-44d9-a771-f72907c18bdb None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:46.156439 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:46.168925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 118/247] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:46.177457 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611a08d-af7b-402f-b35c-7c1bbd0b7a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:46.178532 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611a08d-af7b-402f-b35c-7c1bbd0b7a63 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:46.179023 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611a08d-af7b-402f-b35c-7c1bbd0b7a63 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:46.179472 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611a08d-af7b-402f-b35c-7c1bbd0b7a63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:46.180496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611a08d-af7b-402f-b35c-7c1bbd0b7a63 None admin] RBAC: Adding query filter params (role.id=4fc6ee9bb4ab47abbc8c2e53d38dfadc, scope.project.id=78bf28db88014ad38e46d572425a9c71, user.id=16394eb5a1d24cdfb40754b462f0b85d) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:46.180979 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611a08d-af7b-402f-b35c-7c1bbd0b7a63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:46.182711 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611a08d-af7b-402f-b35c-7c1bbd0b7a63 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:46.189652 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 130/248] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:45 2022] GET /identity/v3/role_assignments?user.id=16394eb5a1d24cdfb40754b462f0b85d&scope.project.id=78bf28db88014ad38e46d572425a9c71&role.id=4fc6ee9bb4ab47abbc8c2e53d38dfadc => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:46.209898 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dae8b3-e542-407a-a326-556058781037 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:46.280525 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:46.288041 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca123e-23a3-4a55-82df-1badd2862d17 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:46.288363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca123e-23a3-4a55-82df-1badd2862d17 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:46.288610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca123e-23a3-4a55-82df-1badd2862d17 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:46.290191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 131/249] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:46.297344 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae020a89-8686-4149-8916-eae294cda35c None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:46.297639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae020a89-8686-4149-8916-eae294cda35c None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:46.297926 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae020a89-8686-4149-8916-eae294cda35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:46.325404 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-ae020a89-8686-4149-8916-eae294cda35c None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:46.327188 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-ae020a89-8686-4149-8916-eae294cda35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:46.335493 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dae8b3-e542-407a-a326-556058781037 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:46.381624 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fe880-3aa4-4f34-aec3-02d977e2ccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:46.382442 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fe880-3aa4-4f34-aec3-02d977e2ccbd None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:46.382731 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fe880-3aa4-4f34-aec3-02d977e2ccbd None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:46.383215 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fe880-3aa4-4f34-aec3-02d977e2ccbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:46.398021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fe880-3aa4-4f34-aec3-02d977e2ccbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-9c8fe880-3aa4-4f34-aec3-02d977e2ccbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:46.406936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:46.407879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:46.408663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:46.408663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:46.408663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:46.408663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:46.408663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:46.408663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:46.408663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:46.408663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:46.408663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:46.408663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:46.408663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:46.408663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:46.408663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 119/250] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:46.414570 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fe880-3aa4-4f34-aec3-02d977e2ccbd None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:46.432296 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 132/251] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:46.458948 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae020a89-8686-4149-8916-eae294cda35c None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:46.542406 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fe880-3aa4-4f34-aec3-02d977e2ccbd None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:46.564275 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:46.588042 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b91d9f-8ab5-4bfc-bbd2-7eeb889f3b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:46.588973 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b91d9f-8ab5-4bfc-bbd2-7eeb889f3b7c None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:46.589084 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b91d9f-8ab5-4bfc-bbd2-7eeb889f3b7c None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:46.589373 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b91d9f-8ab5-4bfc-bbd2-7eeb889f3b7c None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:46.590195 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b91d9f-8ab5-4bfc-bbd2-7eeb889f3b7c None admin] RBAC: Adding query filter params (name=member) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:46.590451 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b91d9f-8ab5-4bfc-bbd2-7eeb889f3b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:46.593052 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b91d9f-8ab5-4bfc-bbd2-7eeb889f3b7c None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:46.596477 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae020a89-8686-4149-8916-eae294cda35c None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:46.603848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 120/252] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:46.610228 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b91d9f-8ab5-4bfc-bbd2-7eeb889f3b7c None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:46.618089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:46.643270 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b1179-8b1a-4f70-8196-5cb14924d4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:46.644092 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b1179-8b1a-4f70-8196-5cb14924d4a3 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:46.644376 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b1179-8b1a-4f70-8196-5cb14924d4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:46.644650 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b1179-8b1a-4f70-8196-5cb14924d4a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:46.657279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b1179-8b1a-4f70-8196-5cb14924d4a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-ee7b1179-8b1a-4f70-8196-5cb14924d4a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:46.668031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:46.668957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:46.669736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:46.669736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:46.669736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:46.669736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:46.669736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:46.669736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:46.669736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:46.669736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:46.669736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:46.669736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:46.669736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:24:46.669736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:46.669736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 133/253] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:24:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:24:46.676855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b1179-8b1a-4f70-8196-5cb14924d4a3 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:46.760728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b91d9f-8ab5-4bfc-bbd2-7eeb889f3b7c None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:46.800927 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb2431-f335-434c-b4d6-c98dccd12f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:46.801728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb2431-f335-434c-b4d6-c98dccd12f04 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:46.802015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb2431-f335-434c-b4d6-c98dccd12f04 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:46.802292 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb2431-f335-434c-b4d6-c98dccd12f04 None admin] PATH_INFO: `/v3/users/3e9cbf90ad1a41b0b9cb9e74e864b53c` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:46.803548 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb2431-f335-434c-b4d6-c98dccd12f04 None admin] RBAC: Authorizing `identity:get_user(user_id=3e9cbf90ad1a41b0b9cb9e74e864b53c)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:46.804988 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb2431-f335-434c-b4d6-c98dccd12f04 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:46.808374 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 121/254] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:46 2022] GET /identity/v3/users/3e9cbf90ad1a41b0b9cb9e74e864b53c => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:46.812390 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb2431-f335-434c-b4d6-c98dccd12f04 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:46.816468 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b1179-8b1a-4f70-8196-5cb14924d4a3 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:46.856961 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f803d61-6f74-4be5-91c7-cee8131db7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:46.857668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f803d61-6f74-4be5-91c7-cee8131db7b8 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:46.858480 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f803d61-6f74-4be5-91c7-cee8131db7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:46.858760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f803d61-6f74-4be5-91c7-cee8131db7b8 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:46.859566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f803d61-6f74-4be5-91c7-cee8131db7b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:46.862887 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f803d61-6f74-4be5-91c7-cee8131db7b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:46.865685 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f803d61-6f74-4be5-91c7-cee8131db7b8 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:46.882337 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 134/255] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:24:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:46.883231 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:46.889965 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f803d61-6f74-4be5-91c7-cee8131db7b8 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:46.944264 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:47.009283 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f803d61-6f74-4be5-91c7-cee8131db7b8 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:47.049705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089b6ae-32a2-41ef-a58c-b568c52ab189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:47.056344 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089b6ae-32a2-41ef-a58c-b568c52ab189 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:47.056640 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089b6ae-32a2-41ef-a58c-b568c52ab189 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:47.056894 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089b6ae-32a2-41ef-a58c-b568c52ab189 None admin] PATH_INFO: `/v3/users/c6e2d0a88bb945be8363d5e736bf715b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:47.058622 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089b6ae-32a2-41ef-a58c-b568c52ab189 None admin] RBAC: Authorizing `identity:get_user(user_id=c6e2d0a88bb945be8363d5e736bf715b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:47.060181 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089b6ae-32a2-41ef-a58c-b568c52ab189 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:47.062713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 135/256] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:46 2022] GET /identity/v3/users/c6e2d0a88bb945be8363d5e736bf715b => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:47.068022 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089b6ae-32a2-41ef-a58c-b568c52ab189 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:47.084928 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb2431-f335-434c-b4d6-c98dccd12f04 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:47.181766 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089b6ae-32a2-41ef-a58c-b568c52ab189 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:47.191641 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:47.207595 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d924c80-9248-4336-8341-c37e79bc69cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:47.208484 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d924c80-9248-4336-8341-c37e79bc69cd None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:47.208772 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d924c80-9248-4336-8341-c37e79bc69cd None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:47.209051 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d924c80-9248-4336-8341-c37e79bc69cd None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:47.214837 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d924c80-9248-4336-8341-c37e79bc69cd None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:47.216561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d924c80-9248-4336-8341-c37e79bc69cd None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:47.217096 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c705828-db2a-4d6e-be2f-c792d716a3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:47.217743 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c705828-db2a-4d6e-be2f-c792d716a3dc None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:47.218028 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c705828-db2a-4d6e-be2f-c792d716a3dc None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:47.218563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c705828-db2a-4d6e-be2f-c792d716a3dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:47.218666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 122/257] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:46 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:47.239888 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d924c80-9248-4336-8341-c37e79bc69cd None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:47.293675 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c705828-db2a-4d6e-be2f-c792d716a3dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:47.295711 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c705828-db2a-4d6e-be2f-c792d716a3dc None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:47.442408 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d924c80-9248-4336-8341-c37e79bc69cd None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:47.468732 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:47.488241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 136/258] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:47.489377 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a1a8f-97e7-4acd-9e43-100a370abd19 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:47.489674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a1a8f-97e7-4acd-9e43-100a370abd19 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:47.489958 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a1a8f-97e7-4acd-9e43-100a370abd19 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:47.491287 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 137/259] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:47.499802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a1a8f-97e7-4acd-9e43-100a370abd19 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:47.520476 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd31d3-7226-4cca-9ec0-1ae06508939b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:47.521029 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:47.521687 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd31d3-7226-4cca-9ec0-1ae06508939b None admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:47.521864 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd31d3-7226-4cca-9ec0-1ae06508939b None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:47.522137 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd31d3-7226-4cca-9ec0-1ae06508939b None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71/users/3e9cbf90ad1a41b0b9cb9e74e864b53c/roles/3bed7bde1b98412b94a181719432cfa1` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:47.526369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd31d3-7226-4cca-9ec0-1ae06508939b None admin] RBAC: Authorizing `identity:create_grant(project_id=78bf28db88014ad38e46d572425a9c71, user_id=3e9cbf90ad1a41b0b9cb9e74e864b53c, role_id=3bed7bde1b98412b94a181719432cfa1)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:47.527914 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd31d3-7226-4cca-9ec0-1ae06508939b None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:47.547205 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 123/260] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:24:47 2022] PUT /identity/v3/projects/78bf28db88014ad38e46d572425a9c71/users/3e9cbf90ad1a41b0b9cb9e74e864b53c/roles/3bed7bde1b98412b94a181719432cfa1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:24:47.549185 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc954d-819f-4710-8fe4-63159332f2a4 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:47.549538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc954d-819f-4710-8fe4-63159332f2a4 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:47.549840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc954d-819f-4710-8fe4-63159332f2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:47.570192 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-d3dc954d-819f-4710-8fe4-63159332f2a4 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:47.571478 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-d3dc954d-819f-4710-8fe4-63159332f2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:47.657037 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 124/261] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:47.684291 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc954d-819f-4710-8fe4-63159332f2a4 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:47.770521 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a1a8f-97e7-4acd-9e43-100a370abd19 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:47.852614 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d9fbd-30fa-49a6-8866-3dab36823696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:47.853818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d9fbd-30fa-49a6-8866-3dab36823696 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:47.854301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d9fbd-30fa-49a6-8866-3dab36823696 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:47.854795 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d9fbd-30fa-49a6-8866-3dab36823696 None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:47.856831 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d9fbd-30fa-49a6-8866-3dab36823696 None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:47.859036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d9fbd-30fa-49a6-8866-3dab36823696 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:47.861573 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 138/262] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:47 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:47.868928 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d9fbd-30fa-49a6-8866-3dab36823696 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:47.880254 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc954d-819f-4710-8fe4-63159332f2a4 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:47.887182 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:47.946497 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae93424-27b1-4dd0-977b-83fb0ecd01b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:47.947684 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae93424-27b1-4dd0-977b-83fb0ecd01b2 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:47.948169 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae93424-27b1-4dd0-977b-83fb0ecd01b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:47.948662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae93424-27b1-4dd0-977b-83fb0ecd01b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:47.969851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae93424-27b1-4dd0-977b-83fb0ecd01b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-9ae93424-27b1-4dd0-977b-83fb0ecd01b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:47.978208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:47.979114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:47.979896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:47.979896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:47.979896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:47.979896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:47.979896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:47.979896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:47.979896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:47.979896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:47.979896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:47.979896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:47.979896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:24:47.979896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:47.988366 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 125/263] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:24:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:24:47.994824 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae93424-27b1-4dd0-977b-83fb0ecd01b2 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:48.017270 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:48.062196 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d9fbd-30fa-49a6-8866-3dab36823696 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:48.144125 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec9f78-83d4-45e2-b6a9-d08e2b3e2140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:48.145176 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec9f78-83d4-45e2-b6a9-d08e2b3e2140 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:48.145664 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec9f78-83d4-45e2-b6a9-d08e2b3e2140 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:48.146183 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec9f78-83d4-45e2-b6a9-d08e2b3e2140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:48.147262 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec9f78-83d4-45e2-b6a9-d08e2b3e2140 None admin] RBAC: Adding query filter params (role.id=5b22d10db4e647389fd8b36e1bc524fd, scope.project.id=78bf28db88014ad38e46d572425a9c71, user.id=c6e2d0a88bb945be8363d5e736bf715b) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:48.147774 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec9f78-83d4-45e2-b6a9-d08e2b3e2140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:48.149414 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec9f78-83d4-45e2-b6a9-d08e2b3e2140 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:48.161543 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 139/264] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:47 2022] GET /identity/v3/role_assignments?user.id=c6e2d0a88bb945be8363d5e736bf715b&scope.project.id=78bf28db88014ad38e46d572425a9c71&role.id=5b22d10db4e647389fd8b36e1bc524fd => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:48.196787 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae93424-27b1-4dd0-977b-83fb0ecd01b2 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:48.252682 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c831a-314b-443e-85ec-96cf2b176c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:48.253792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c831a-314b-443e-85ec-96cf2b176c56 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:48.254281 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c831a-314b-443e-85ec-96cf2b176c56 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:48.254781 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c831a-314b-443e-85ec-96cf2b176c56 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:48.255814 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c831a-314b-443e-85ec-96cf2b176c56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:48.256338 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c831a-314b-443e-85ec-96cf2b176c56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:48.257992 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c831a-314b-443e-85ec-96cf2b176c56 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:48.273493 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 126/265] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:48.279316 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec9f78-83d4-45e2-b6a9-d08e2b3e2140 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:48.423540 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec9f78-83d4-45e2-b6a9-d08e2b3e2140 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:48.477698 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ef9f5-d0ea-4510-aeae-a323a898b3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:48.478591 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ef9f5-d0ea-4510-aeae-a323a898b3f2 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:48.478893 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ef9f5-d0ea-4510-aeae-a323a898b3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:48.479177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ef9f5-d0ea-4510-aeae-a323a898b3f2 None admin] PATH_INFO: `/v3/users/c6e2d0a88bb945be8363d5e736bf715b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:48.483749 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ef9f5-d0ea-4510-aeae-a323a898b3f2 None admin] RBAC: Authorizing `identity:get_user(user_id=c6e2d0a88bb945be8363d5e736bf715b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:48.485501 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ef9f5-d0ea-4510-aeae-a323a898b3f2 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:48.487610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 140/266] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:48 2022] GET /identity/v3/users/c6e2d0a88bb945be8363d5e736bf715b => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:48.496033 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c831a-314b-443e-85ec-96cf2b176c56 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:48.537441 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:48.630259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c831a-314b-443e-85ec-96cf2b176c56 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:48.673214 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd574a-e9a6-45ee-b883-109059132b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:48.673932 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd574a-e9a6-45ee-b883-109059132b82 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:48.674211 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd574a-e9a6-45ee-b883-109059132b82 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:48.674498 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd574a-e9a6-45ee-b883-109059132b82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:48.766257 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd574a-e9a6-45ee-b883-109059132b82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:48.767749 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd574a-e9a6-45ee-b883-109059132b82 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:48.802119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:48.899666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 127/267] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:48.905790 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ef9f5-d0ea-4510-aeae-a323a898b3f2 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:48.923081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:49.063646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ef9f5-d0ea-4510-aeae-a323a898b3f2 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:49.113509 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326077cb-82cd-4df4-aa7b-171aeb6de37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:49.114372 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326077cb-82cd-4df4-aa7b-171aeb6de37f None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:49.114655 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326077cb-82cd-4df4-aa7b-171aeb6de37f None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:49.114957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326077cb-82cd-4df4-aa7b-171aeb6de37f None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:49.119589 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326077cb-82cd-4df4-aa7b-171aeb6de37f None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:49.121063 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326077cb-82cd-4df4-aa7b-171aeb6de37f None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:49.123111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 141/268] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:48 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:49.129075 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326077cb-82cd-4df4-aa7b-171aeb6de37f None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:49.129608 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22439b4d-c82f-41de-bb6d-70cc609ae206 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:49.129906 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22439b4d-c82f-41de-bb6d-70cc609ae206 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:49.130194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22439b4d-c82f-41de-bb6d-70cc609ae206 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:49.131736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 128/269] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:49.137196 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea17ea-989e-421d-b78e-b2a0f05f4b8c None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:49.137484 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea17ea-989e-421d-b78e-b2a0f05f4b8c None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:49.137769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea17ea-989e-421d-b78e-b2a0f05f4b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:49.187738 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-72ea17ea-989e-421d-b78e-b2a0f05f4b8c None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:49.188982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-72ea17ea-989e-421d-b78e-b2a0f05f4b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:49.207433 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:49.233985 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326077cb-82cd-4df4-aa7b-171aeb6de37f None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:49.270482 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10875dd5-b352-41ba-9402-cc9a8db96c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:49.271179 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10875dd5-b352-41ba-9402-cc9a8db96c81 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:49.271468 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10875dd5-b352-41ba-9402-cc9a8db96c81 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:49.271753 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10875dd5-b352-41ba-9402-cc9a8db96c81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:49.272591 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10875dd5-b352-41ba-9402-cc9a8db96c81 None admin] RBAC: Adding query filter params (role.id=923dd61feaca45d0933a4601fb2c065b, scope.project.id=78bf28db88014ad38e46d572425a9c71, user.id=c6e2d0a88bb945be8363d5e736bf715b) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:49.272906 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10875dd5-b352-41ba-9402-cc9a8db96c81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:49.274362 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10875dd5-b352-41ba-9402-cc9a8db96c81 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:49.300712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 142/270] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:49 2022] GET /identity/v3/role_assignments?user.id=c6e2d0a88bb945be8363d5e736bf715b&scope.project.id=78bf28db88014ad38e46d572425a9c71&role.id=923dd61feaca45d0933a4601fb2c065b => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:49.348466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 129/271] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:49.386937 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10875dd5-b352-41ba-9402-cc9a8db96c81 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:49.522076 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10875dd5-b352-41ba-9402-cc9a8db96c81 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:49.561749 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc51e25-0243-4a1d-b4fb-084bbd2c625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:49.562570 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc51e25-0243-4a1d-b4fb-084bbd2c625f None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:49.562883 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc51e25-0243-4a1d-b4fb-084bbd2c625f None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:49.563168 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc51e25-0243-4a1d-b4fb-084bbd2c625f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:49.571234 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:49.575374 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc51e25-0243-4a1d-b4fb-084bbd2c625f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-adc51e25-0243-4a1d-b4fb-084bbd2c625f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:49.584613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:49.585582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:49.586354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:49.586354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:49.586354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:49.586354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:49.586354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:49.586354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:49.586354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:49.586354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:49.586354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:49.586354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:49.586354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:49.586354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:49.593448 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 143/272] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:49.599764 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea17ea-989e-421d-b78e-b2a0f05f4b8c None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:49.662188 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:49.701188 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9801add-de97-4da8-be3d-46164b6b424d None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:49.702042 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9801add-de97-4da8-be3d-46164b6b424d None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:49.702325 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9801add-de97-4da8-be3d-46164b6b424d None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:49.703746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 144/273] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:24:49.711356 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a53ea4-5c64-406a-8d57-da89432b9fff None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:49.711644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a53ea4-5c64-406a-8d57-da89432b9fff None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:49.711923 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a53ea4-5c64-406a-8d57-da89432b9fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:49.718085 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea17ea-989e-421d-b78e-b2a0f05f4b8c None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:49.733353 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-b9a53ea4-5c64-406a-8d57-da89432b9fff None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:49.734720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-b9a53ea4-5c64-406a-8d57-da89432b9fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:49.759714 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc984f-03bc-4c5c-948d-3af568f34439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:49.760399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc984f-03bc-4c5c-948d-3af568f34439 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:49.761177 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc984f-03bc-4c5c-948d-3af568f34439 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:49.761463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc984f-03bc-4c5c-948d-3af568f34439 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:49.763365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc984f-03bc-4c5c-948d-3af568f34439 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:49.763683 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc984f-03bc-4c5c-948d-3af568f34439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:49.766132 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc984f-03bc-4c5c-948d-3af568f34439 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:49.776530 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 130/274] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:49.784764 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc984f-03bc-4c5c-948d-3af568f34439 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:49.820081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 145/275] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:49.821365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa34fdf-9ccf-4f71-928c-953a69211e41 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:49.821670 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa34fdf-9ccf-4f71-928c-953a69211e41 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:49.821952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa34fdf-9ccf-4f71-928c-953a69211e41 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:49.825681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 146/276] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:49.832444 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceba161-94df-4ba8-b187-f0f4fa1aaa72 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:49.832735 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceba161-94df-4ba8-b187-f0f4fa1aaa72 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:49.833015 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceba161-94df-4ba8-b187-f0f4fa1aaa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:49.852611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-eceba161-94df-4ba8-b187-f0f4fa1aaa72 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:49.854259 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-eceba161-94df-4ba8-b187-f0f4fa1aaa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:49.918987 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc984f-03bc-4c5c-948d-3af568f34439 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:49.933779 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 147/277] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:49.937958 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:49.940889 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceba161-94df-4ba8-b187-f0f4fa1aaa72 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:49.961658 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13195bb7-919c-4df8-9a0b-e85609de26f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:49.963414 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13195bb7-919c-4df8-9a0b-e85609de26f0 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:49.963897 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13195bb7-919c-4df8-9a0b-e85609de26f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:49.964636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13195bb7-919c-4df8-9a0b-e85609de26f0 None admin] PATH_INFO: `/v3/users/16394eb5a1d24cdfb40754b462f0b85d` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:49.966329 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13195bb7-919c-4df8-9a0b-e85609de26f0 None admin] RBAC: Authorizing `identity:get_user(user_id=16394eb5a1d24cdfb40754b462f0b85d)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:49.968819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13195bb7-919c-4df8-9a0b-e85609de26f0 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:49.971052 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 131/278] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:49 2022] GET /identity/v3/users/16394eb5a1d24cdfb40754b462f0b85d => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:49.971673 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13195bb7-919c-4df8-9a0b-e85609de26f0 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:50.002424 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:50.048757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceba161-94df-4ba8-b187-f0f4fa1aaa72 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:50.085170 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13195bb7-919c-4df8-9a0b-e85609de26f0 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:50.095294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96d7c6-244b-4483-a056-1c2452617fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:50.096768 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96d7c6-244b-4483-a056-1c2452617fb0 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:50.097066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96d7c6-244b-4483-a056-1c2452617fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:50.097344 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96d7c6-244b-4483-a056-1c2452617fb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:50.108808 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96d7c6-244b-4483-a056-1c2452617fb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-5f96d7c6-244b-4483-a056-1c2452617fb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:50.116561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:50.117432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:50.118226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:50.118226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:50.118226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:50.118226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:50.118226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:50.118226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:50.118226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:50.118226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:50.118226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:50.118226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:50.118226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:50.118226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:50.118226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 148/279] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:50.119505 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96d7c6-244b-4483-a056-1c2452617fb0 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:50.122673 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdbb77-0690-425f-9130-70124087a401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:50.124147 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdbb77-0690-425f-9130-70124087a401 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:50.124428 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdbb77-0690-425f-9130-70124087a401 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:50.124702 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdbb77-0690-425f-9130-70124087a401 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:50.125888 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdbb77-0690-425f-9130-70124087a401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:50.127360 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdbb77-0690-425f-9130-70124087a401 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:50.128997 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 132/280] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:50.129747 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdbb77-0690-425f-9130-70124087a401 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:50.190212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:50.227546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96d7c6-244b-4483-a056-1c2452617fb0 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:50.240834 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdbb77-0690-425f-9130-70124087a401 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:50.243849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:50.265463 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260de95-0d20-43c7-b78c-9b0f08666b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:50.266355 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260de95-0d20-43c7-b78c-9b0f08666b07 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:50.266641 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260de95-0d20-43c7-b78c-9b0f08666b07 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:50.266986 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260de95-0d20-43c7-b78c-9b0f08666b07 None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:50.268177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260de95-0d20-43c7-b78c-9b0f08666b07 None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:50.269621 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260de95-0d20-43c7-b78c-9b0f08666b07 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:50.271363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 149/281] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:50 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:50.276156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260de95-0d20-43c7-b78c-9b0f08666b07 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:50.283972 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404a261-7fb0-4bf0-94a1-deeffdf99aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:50.284651 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404a261-7fb0-4bf0-94a1-deeffdf99aee None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:50.284930 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404a261-7fb0-4bf0-94a1-deeffdf99aee None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:50.285212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404a261-7fb0-4bf0-94a1-deeffdf99aee None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:50.285955 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404a261-7fb0-4bf0-94a1-deeffdf99aee None admin] RBAC: Adding query filter params (name=member) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:50.286265 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404a261-7fb0-4bf0-94a1-deeffdf99aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:50.287897 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404a261-7fb0-4bf0-94a1-deeffdf99aee None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:50.297483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 133/282] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:50.298255 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404a261-7fb0-4bf0-94a1-deeffdf99aee None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:50.393606 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260de95-0d20-43c7-b78c-9b0f08666b07 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:50.408363 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404a261-7fb0-4bf0-94a1-deeffdf99aee None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:50.425502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:50.433128 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538596de-9a4c-4510-a937-8143f9cb9190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:50.433652 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538596de-9a4c-4510-a937-8143f9cb9190 None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:50.433933 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538596de-9a4c-4510-a937-8143f9cb9190 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:50.434216 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538596de-9a4c-4510-a937-8143f9cb9190 None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:50.434949 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538596de-9a4c-4510-a937-8143f9cb9190 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:50.437109 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538596de-9a4c-4510-a937-8143f9cb9190 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:50.444773 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4548de-3035-4614-a4e4-717a77cd60e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:50.445748 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4548de-3035-4614-a4e4-717a77cd60e3 None admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:50.446226 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4548de-3035-4614-a4e4-717a77cd60e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:50.446349 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4548de-3035-4614-a4e4-717a77cd60e3 None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71/users/16394eb5a1d24cdfb40754b462f0b85d/roles/4fc6ee9bb4ab47abbc8c2e53d38dfadc` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:50.448773 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4548de-3035-4614-a4e4-717a77cd60e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=78bf28db88014ad38e46d572425a9c71, user_id=16394eb5a1d24cdfb40754b462f0b85d, role_id=4fc6ee9bb4ab47abbc8c2e53d38dfadc)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:50.450553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4548de-3035-4614-a4e4-717a77cd60e3 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:50.460803 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 150/283] 10.222.0.86 () {60 vars in 1132 bytes} [Fri Jul 15 16:24:50 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:24:50.461514 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538596de-9a4c-4510-a937-8143f9cb9190 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:50.478583 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 134/284] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:24:50 2022] PUT /identity/v3/projects/78bf28db88014ad38e46d572425a9c71/users/16394eb5a1d24cdfb40754b462f0b85d/roles/4fc6ee9bb4ab47abbc8c2e53d38dfadc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:24:50.531352 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:50.604076 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538596de-9a4c-4510-a937-8143f9cb9190 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:50.634376 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af340e1-2050-4558-877d-a25210875340 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:50.634692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af340e1-2050-4558-877d-a25210875340 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:50.634993 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af340e1-2050-4558-877d-a25210875340 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:50.640065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 135/285] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:24:50.642776 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1dffc-72d0-44e2-a4c0-943b6204b872 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:50.643119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1dffc-72d0-44e2-a4c0-943b6204b872 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:50.643409 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1dffc-72d0-44e2-a4c0-943b6204b872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:50.645355 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d34e4c-f4a5-4e48-8207-8e9e8cc025fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:50.646198 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d34e4c-f4a5-4e48-8207-8e9e8cc025fe None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:50.646487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d34e4c-f4a5-4e48-8207-8e9e8cc025fe None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:50.646780 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d34e4c-f4a5-4e48-8207-8e9e8cc025fe None admin] PATH_INFO: `/v3/users/badc62a7a31f40aba0900a781446e4df` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:50.662931 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-11a1dffc-72d0-44e2-a4c0-943b6204b872 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:50.664185 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-11a1dffc-72d0-44e2-a4c0-943b6204b872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:50.670809 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d34e4c-f4a5-4e48-8207-8e9e8cc025fe None admin] RBAC: Authorizing `identity:get_user(user_id=badc62a7a31f40aba0900a781446e4df)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:50.672739 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d34e4c-f4a5-4e48-8207-8e9e8cc025fe None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:50.676146 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 151/286] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:50 2022] GET /identity/v3/users/badc62a7a31f40aba0900a781446e4df => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:50.684703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d34e4c-f4a5-4e48-8207-8e9e8cc025fe None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:50.757821 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 136/287] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:50.783499 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1dffc-72d0-44e2-a4c0-943b6204b872 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:50.807873 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:50.811744 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d34e4c-f4a5-4e48-8207-8e9e8cc025fe None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:50.857226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb51c99-14e3-4028-a57a-cb208ffa547a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:50.858250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb51c99-14e3-4028-a57a-cb208ffa547a None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:50.858538 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb51c99-14e3-4028-a57a-cb208ffa547a None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:50.858840 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb51c99-14e3-4028-a57a-cb208ffa547a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:50.859801 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb51c99-14e3-4028-a57a-cb208ffa547a None admin] RBAC: Adding query filter params (role.id=3bed7bde1b98412b94a181719432cfa1, user.id=badc62a7a31f40aba0900a781446e4df, scope.system=all) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:50.860118 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb51c99-14e3-4028-a57a-cb208ffa547a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:50.861595 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb51c99-14e3-4028-a57a-cb208ffa547a None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:50.870135 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 152/288] 10.222.0.86 () {56 vars in 1308 bytes} [Fri Jul 15 16:24:50 2022] GET /identity/v3/role_assignments?user.id=badc62a7a31f40aba0900a781446e4df&scope.system=all&role.id=3bed7bde1b98412b94a181719432cfa1 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:50.932267 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1dffc-72d0-44e2-a4c0-943b6204b872 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:50.942647 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:50.977223 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d33900-b27f-4c79-8dea-68078c50c234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:50.978037 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d33900-b27f-4c79-8dea-68078c50c234 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:50.978320 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d33900-b27f-4c79-8dea-68078c50c234 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:50.978597 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d33900-b27f-4c79-8dea-68078c50c234 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:50.991449 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d33900-b27f-4c79-8dea-68078c50c234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-a1d33900-b27f-4c79-8dea-68078c50c234 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:51.000148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:51.001106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:51.001890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:51.001890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:51.001890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:51.001890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:51.001890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:51.001890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:51.001890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:51.001890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:51.001890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:51.001890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:51.001890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:51.001890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:51.001890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 137/289] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:24:51.007707 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb51c99-14e3-4028-a57a-cb208ffa547a None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:51.131024 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb51c99-14e3-4028-a57a-cb208ffa547a None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:51.171829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de70466-bd2e-405f-946f-b0bfd8f959d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:51.172499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de70466-bd2e-405f-946f-b0bfd8f959d9 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:51.172780 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de70466-bd2e-405f-946f-b0bfd8f959d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:51.173055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de70466-bd2e-405f-946f-b0bfd8f959d9 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:51.173849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de70466-bd2e-405f-946f-b0bfd8f959d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:51.174154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de70466-bd2e-405f-946f-b0bfd8f959d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:51.175644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de70466-bd2e-405f-946f-b0bfd8f959d9 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:51.184465 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 153/290] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:51.190031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d33900-b27f-4c79-8dea-68078c50c234 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:51.314981 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d33900-b27f-4c79-8dea-68078c50c234 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:51.356116 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d049d3-1c1d-426e-a21c-bf970424d9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:51.357237 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d049d3-1c1d-426e-a21c-bf970424d9b6 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:51.357561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d049d3-1c1d-426e-a21c-bf970424d9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:51.358428 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d049d3-1c1d-426e-a21c-bf970424d9b6 None admin] PATH_INFO: `/v3/users/3e9cbf90ad1a41b0b9cb9e74e864b53c` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:51.359953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d049d3-1c1d-426e-a21c-bf970424d9b6 None admin] RBAC: Authorizing `identity:get_user(user_id=3e9cbf90ad1a41b0b9cb9e74e864b53c)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:51.361406 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d049d3-1c1d-426e-a21c-bf970424d9b6 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:51.363150 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 138/291] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:51 2022] GET /identity/v3/users/3e9cbf90ad1a41b0b9cb9e74e864b53c => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:51.368753 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de70466-bd2e-405f-946f-b0bfd8f959d9 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:51.411547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:51.500741 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de70466-bd2e-405f-946f-b0bfd8f959d9 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:51.553918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8d67f-ed85-42bf-89b6-61f7926709a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:51.554572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8d67f-ed85-42bf-89b6-61f7926709a0 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:51.554858 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8d67f-ed85-42bf-89b6-61f7926709a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:51.555170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8d67f-ed85-42bf-89b6-61f7926709a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:51.637351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8d67f-ed85-42bf-89b6-61f7926709a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:51.639425 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8d67f-ed85-42bf-89b6-61f7926709a0 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:51.680890 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:51.762113 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 154/292] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:51.768253 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d049d3-1c1d-426e-a21c-bf970424d9b6 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:51.804465 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:51.906171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d049d3-1c1d-426e-a21c-bf970424d9b6 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:51.952017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d44de-a112-4610-9ae1-ce0ce987ecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:51.952900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d44de-a112-4610-9ae1-ce0ce987ecfb None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:51.953185 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d44de-a112-4610-9ae1-ce0ce987ecfb None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:51.953465 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d44de-a112-4610-9ae1-ce0ce987ecfb None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:51.959892 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d44de-a112-4610-9ae1-ce0ce987ecfb None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:51.961400 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d44de-a112-4610-9ae1-ce0ce987ecfb None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:51.963688 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 139/293] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:51 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:51.969874 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8d67f-ed85-42bf-89b6-61f7926709a0 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:52.110209 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8d67f-ed85-42bf-89b6-61f7926709a0 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:52.135740 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:52.145326 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d040e-d375-45b6-9c92-4d4dcddda24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:52.145988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d040e-d375-45b6-9c92-4d4dcddda24c None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:52.146270 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d040e-d375-45b6-9c92-4d4dcddda24c None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:52.146548 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d040e-d375-45b6-9c92-4d4dcddda24c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:52.147417 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d040e-d375-45b6-9c92-4d4dcddda24c None admin] RBAC: Adding query filter params (role.id=3bed7bde1b98412b94a181719432cfa1, scope.project.id=78bf28db88014ad38e46d572425a9c71, user.id=3e9cbf90ad1a41b0b9cb9e74e864b53c) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:52.147732 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d040e-d375-45b6-9c92-4d4dcddda24c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:52.149166 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d040e-d375-45b6-9c92-4d4dcddda24c None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:52.156342 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 155/294] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:51 2022] GET /identity/v3/role_assignments?user.id=3e9cbf90ad1a41b0b9cb9e74e864b53c&scope.project.id=78bf28db88014ad38e46d572425a9c71&role.id=3bed7bde1b98412b94a181719432cfa1 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:53.126648 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16eab23-a11f-48f0-a1d0-b91f1bba8aa0 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:53.127674 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16eab23-a11f-48f0-a1d0-b91f1bba8aa0 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:53.128164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16eab23-a11f-48f0-a1d0-b91f1bba8aa0 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:53.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 140/295] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:53.135382 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c49650-6d62-4c90-986c-a538b99cb8f3 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:53.136224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c49650-6d62-4c90-986c-a538b99cb8f3 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:53.136703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c49650-6d62-4c90-986c-a538b99cb8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:53.153633 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-e9c49650-6d62-4c90-986c-a538b99cb8f3 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:53.155223 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-e9c49650-6d62-4c90-986c-a538b99cb8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:53.230297 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 156/296] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:53.255571 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16eab23-a11f-48f0-a1d0-b91f1bba8aa0 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:53.343161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d32c3c-fb30-43d4-9683-69e4e76ec9da None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:53.343446 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d32c3c-fb30-43d4-9683-69e4e76ec9da None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:53.343995 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d32c3c-fb30-43d4-9683-69e4e76ec9da None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:53.345802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 157/297] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:24:53.351020 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda62296-ef52-432f-b5dc-c3422bda3745 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:53.351552 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda62296-ef52-432f-b5dc-c3422bda3745 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:53.352029 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda62296-ef52-432f-b5dc-c3422bda3745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:53.364334 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16eab23-a11f-48f0-a1d0-b91f1bba8aa0 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:53.365897 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:53.371150 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-bda62296-ef52-432f-b5dc-c3422bda3745 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:53.372578 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-bda62296-ef52-432f-b5dc-c3422bda3745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:53.403205 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c40f2-65e0-4bbe-b544-b419d9ffcc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:53.403931 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c40f2-65e0-4bbe-b544-b419d9ffcc1b None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:53.404219 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c40f2-65e0-4bbe-b544-b419d9ffcc1b None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:53.404543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c40f2-65e0-4bbe-b544-b419d9ffcc1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:53.417399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c40f2-65e0-4bbe-b544-b419d9ffcc1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-075c40f2-65e0-4bbe-b544-b419d9ffcc1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:53.425602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:53.426553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:53.427742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:53.427742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:53.427742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:53.427742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:53.427742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:53.427742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:53.427742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:53.427742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:53.427742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:53.427742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:53.427742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:53.427742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:53.431662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 141/298] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:53.432509 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c40f2-65e0-4bbe-b544-b419d9ffcc1b None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:53.466993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 158/299] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:24:53.496763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda62296-ef52-432f-b5dc-c3422bda3745 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:53.573061 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:53.580624 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c40f2-65e0-4bbe-b544-b419d9ffcc1b None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:53.618197 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cb532-210b-4d20-b3c5-e609a87733df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:53.618906 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cb532-210b-4d20-b3c5-e609a87733df None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:53.619200 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cb532-210b-4d20-b3c5-e609a87733df None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:53.619483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cb532-210b-4d20-b3c5-e609a87733df None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:53.620226 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cb532-210b-4d20-b3c5-e609a87733df None admin] RBAC: Adding query filter params (name=reader) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:53.620541 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cb532-210b-4d20-b3c5-e609a87733df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:53.621905 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cb532-210b-4d20-b3c5-e609a87733df None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:53.630162 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda62296-ef52-432f-b5dc-c3422bda3745 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:53.630446 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 142/300] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:53.635236 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e9b92-ac2f-463a-acc0-31e0e2292d64 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:53.635236 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e9b92-ac2f-463a-acc0-31e0e2292d64 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:53.635236 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e9b92-ac2f-463a-acc0-31e0e2292d64 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:53.635236 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 143/301] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:53.635815 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e9b92-ac2f-463a-acc0-31e0e2292d64 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:53.661575 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:53.672283 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c5353-207b-4ede-815b-b7e6f9bf95bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:53.673077 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c5353-207b-4ede-815b-b7e6f9bf95bd None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:53.673362 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c5353-207b-4ede-815b-b7e6f9bf95bd None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:53.673639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c5353-207b-4ede-815b-b7e6f9bf95bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:53.683633 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c5353-207b-4ede-815b-b7e6f9bf95bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-1b5c5353-207b-4ede-815b-b7e6f9bf95bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:53.691450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:53.692335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:53.693129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:53.693129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:53.693129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:53.693129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:53.693129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:53.693129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:53.693129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:53.693129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:53.693129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:53.693129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:53.693129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:53.693129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:53.693129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 159/302] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:24:53.693981 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38d370-7796-4f22-827c-a83aa320fd58 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:53.694361 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38d370-7796-4f22-827c-a83aa320fd58 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:53.694542 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38d370-7796-4f22-827c-a83aa320fd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:53.711372 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-0f38d370-7796-4f22-827c-a83aa320fd58 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:53.712569 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-0f38d370-7796-4f22-827c-a83aa320fd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:53.743131 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e9b92-ac2f-463a-acc0-31e0e2292d64 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:53.776364 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c979d-842f-491a-a7ab-e84acd27bfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:53.777230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c979d-842f-491a-a7ab-e84acd27bfbb None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:53.777513 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c979d-842f-491a-a7ab-e84acd27bfbb None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:53.777786 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c979d-842f-491a-a7ab-e84acd27bfbb None admin] PATH_INFO: `/v3/users/16394eb5a1d24cdfb40754b462f0b85d` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:53.777872 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 160/303] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:53.779031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c979d-842f-491a-a7ab-e84acd27bfbb None admin] RBAC: Authorizing `identity:get_user(user_id=16394eb5a1d24cdfb40754b462f0b85d)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:53.779241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286c4dc-9ada-4224-923b-0f8d0c6e202b None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:53.779968 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286c4dc-9ada-4224-923b-0f8d0c6e202b None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:53.780243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286c4dc-9ada-4224-923b-0f8d0c6e202b None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:53.781068 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c979d-842f-491a-a7ab-e84acd27bfbb None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:53.781677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 161/304] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:53.782206 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286c4dc-9ada-4224-923b-0f8d0c6e202b None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:53.782947 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 144/305] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:53 2022] GET /identity/v3/users/16394eb5a1d24cdfb40754b462f0b85d => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:53.788223 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813ff67-b2a6-4fe2-a58a-c573e96f9162 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:53.788512 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813ff67-b2a6-4fe2-a58a-c573e96f9162 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:53.788787 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813ff67-b2a6-4fe2-a58a-c573e96f9162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:53.810296 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-f813ff67-b2a6-4fe2-a58a-c573e96f9162 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:53.811494 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-f813ff67-b2a6-4fe2-a58a-c573e96f9162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:53.825078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:53.877704 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 145/306] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:53.878552 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813ff67-b2a6-4fe2-a58a-c573e96f9162 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:53.887233 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286c4dc-9ada-4224-923b-0f8d0c6e202b None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:53.905671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:53.923139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb3f2c-f85e-401d-a5c5-37d1bcff48a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:53.923803 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb3f2c-f85e-401d-a5c5-37d1bcff48a6 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:53.924093 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb3f2c-f85e-401d-a5c5-37d1bcff48a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:53.924370 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb3f2c-f85e-401d-a5c5-37d1bcff48a6 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:53.925110 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb3f2c-f85e-401d-a5c5-37d1bcff48a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:53.925417 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb3f2c-f85e-401d-a5c5-37d1bcff48a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:53.926783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb3f2c-f85e-401d-a5c5-37d1bcff48a6 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:53.934827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 162/307] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:53.936303 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb3f2c-f85e-401d-a5c5-37d1bcff48a6 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:53.983082 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813ff67-b2a6-4fe2-a58a-c573e96f9162 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:54.015643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f543095-9bd5-4ddf-a2c7-599369ecbc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:54.016290 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f543095-9bd5-4ddf-a2c7-599369ecbc20 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:54.016733 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f543095-9bd5-4ddf-a2c7-599369ecbc20 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:54.017013 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f543095-9bd5-4ddf-a2c7-599369ecbc20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:54.032377 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb3f2c-f85e-401d-a5c5-37d1bcff48a6 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:54.033858 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:54.067140 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95bd53-1059-43fb-9ab6-33167b62d187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:54.067928 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95bd53-1059-43fb-9ab6-33167b62d187 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:54.068212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95bd53-1059-43fb-9ab6-33167b62d187 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:54.068487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95bd53-1059-43fb-9ab6-33167b62d187 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:54.079041 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95bd53-1059-43fb-9ab6-33167b62d187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:54.084709 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f543095-9bd5-4ddf-a2c7-599369ecbc20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:54.086171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f543095-9bd5-4ddf-a2c7-599369ecbc20 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-fd95bd53-1059-43fb-9ab6-33167b62d187 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:54.086720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:54.087714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:54.088528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:54.088528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:54.088528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:54.088528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:54.088528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:54.088528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:54.088528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:54.088528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:54.088528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:54.088528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:54.088528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:54.088528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:24:54.088528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 163/308] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:54.089164 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95bd53-1059-43fb-9ab6-33167b62d187 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:54.111190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:54.187297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 146/309] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:24:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:24:54.188040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f543095-9bd5-4ddf-a2c7-599369ecbc20 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:54.195631 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95bd53-1059-43fb-9ab6-33167b62d187 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:54.229155 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de59ad6-c7fc-4dd3-bb7e-480ca02c335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:54.229923 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de59ad6-c7fc-4dd3-bb7e-480ca02c335b None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:54.230204 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de59ad6-c7fc-4dd3-bb7e-480ca02c335b None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:54.230481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de59ad6-c7fc-4dd3-bb7e-480ca02c335b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:54.231673 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de59ad6-c7fc-4dd3-bb7e-480ca02c335b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:54.233652 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de59ad6-c7fc-4dd3-bb7e-480ca02c335b None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:54.235289 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 164/310] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:54.236048 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de59ad6-c7fc-4dd3-bb7e-480ca02c335b None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:54.269587 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:54.285555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f543095-9bd5-4ddf-a2c7-599369ecbc20 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:54.307846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:54.319725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05243af-3181-475a-8082-6f8a09c4fed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:54.320621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05243af-3181-475a-8082-6f8a09c4fed8 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:54.321027 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05243af-3181-475a-8082-6f8a09c4fed8 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:54.321304 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05243af-3181-475a-8082-6f8a09c4fed8 None admin] PATH_INFO: `/v3/users/badc62a7a31f40aba0900a781446e4df` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:54.322493 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05243af-3181-475a-8082-6f8a09c4fed8 None admin] RBAC: Authorizing `identity:get_user(user_id=badc62a7a31f40aba0900a781446e4df)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:54.323961 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05243af-3181-475a-8082-6f8a09c4fed8 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:54.330598 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 147/311] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:54 2022] GET /identity/v3/users/badc62a7a31f40aba0900a781446e4df => generated 293 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:54.330598 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05243af-3181-475a-8082-6f8a09c4fed8 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:54.341353 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de59ad6-c7fc-4dd3-bb7e-480ca02c335b None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:54.376218 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8c42a-a8c3-4a84-96fd-6cad0bde309a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:54.376900 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8c42a-a8c3-4a84-96fd-6cad0bde309a None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:54.377186 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8c42a-a8c3-4a84-96fd-6cad0bde309a None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:54.377462 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8c42a-a8c3-4a84-96fd-6cad0bde309a None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:54.378204 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8c42a-a8c3-4a84-96fd-6cad0bde309a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:54.378511 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8c42a-a8c3-4a84-96fd-6cad0bde309a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:54.379900 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8c42a-a8c3-4a84-96fd-6cad0bde309a None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:54.387677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 165/312] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:54.388429 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8c42a-a8c3-4a84-96fd-6cad0bde309a None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:54.429945 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05243af-3181-475a-8082-6f8a09c4fed8 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:54.464034 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe2894-c02a-4c56-8327-6a0758c9a200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:54.464846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe2894-c02a-4c56-8327-6a0758c9a200 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:54.465137 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe2894-c02a-4c56-8327-6a0758c9a200 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:54.465414 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe2894-c02a-4c56-8327-6a0758c9a200 None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:54.466600 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe2894-c02a-4c56-8327-6a0758c9a200 None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:54.468625 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe2894-c02a-4c56-8327-6a0758c9a200 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:54.470332 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 148/313] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:24:54 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:54.471191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe2894-c02a-4c56-8327-6a0758c9a200 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:54.480801 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:54.490993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8c42a-a8c3-4a84-96fd-6cad0bde309a None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:54.523731 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8d505-b842-45e3-8c37-03e90fdd2ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:54.524390 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8d505-b842-45e3-8c37-03e90fdd2ad7 None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:54.524691 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8d505-b842-45e3-8c37-03e90fdd2ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:54.524961 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8d505-b842-45e3-8c37-03e90fdd2ad7 None admin] PATH_INFO: `/v3/groups` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:54.525648 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8d505-b842-45e3-8c37-03e90fdd2ad7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:54.527140 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8d505-b842-45e3-8c37-03e90fdd2ad7 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:54.530975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:54.541545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 166/314] 10.222.0.86 () {60 vars in 1134 bytes} [Fri Jul 15 16:24:54 2022] POST /identity/v3/groups => generated 229 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:24:54.542425 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8d505-b842-45e3-8c37-03e90fdd2ad7 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:54.583864 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe2894-c02a-4c56-8327-6a0758c9a200 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:54.624012 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cdb91-22fb-4f54-b4ef-476eb60b1de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:54.624894 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cdb91-22fb-4f54-b4ef-476eb60b1de2 None admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:54.625179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cdb91-22fb-4f54-b4ef-476eb60b1de2 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:54.625462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cdb91-22fb-4f54-b4ef-476eb60b1de2 None admin] PATH_INFO: `/v3/system/users/badc62a7a31f40aba0900a781446e4df/roles/3bed7bde1b98412b94a181719432cfa1` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:54.627102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cdb91-22fb-4f54-b4ef-476eb60b1de2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=badc62a7a31f40aba0900a781446e4df, role_id=3bed7bde1b98412b94a181719432cfa1)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:54.628599 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cdb91-22fb-4f54-b4ef-476eb60b1de2 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:54.638542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 149/315] 10.222.0.86 () {58 vars in 1334 bytes} [Fri Jul 15 16:24:54 2022] PUT /identity/v3/system/users/badc62a7a31f40aba0900a781446e4df/roles/3bed7bde1b98412b94a181719432cfa1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:24:54.639781 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cdb91-22fb-4f54-b4ef-476eb60b1de2 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:54.664413 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8d505-b842-45e3-8c37-03e90fdd2ad7 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:54.706119 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39d129-ad5e-4547-a6af-06a361d848d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:54.707697 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39d129-ad5e-4547-a6af-06a361d848d8 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:54.708001 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39d129-ad5e-4547-a6af-06a361d848d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:54.708291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39d129-ad5e-4547-a6af-06a361d848d8 None admin] PATH_INFO: `/v3/users/9d9ae545670a4fe1994124f91a8e1fb8` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:54.739631 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39d129-ad5e-4547-a6af-06a361d848d8 None admin] RBAC: Authorizing `identity:get_user(user_id=9d9ae545670a4fe1994124f91a8e1fb8)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:54.740528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39d129-ad5e-4547-a6af-06a361d848d8 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:54.742953 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 167/316] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:54 2022] GET /identity/v3/users/9d9ae545670a4fe1994124f91a8e1fb8 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:54.749275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39d129-ad5e-4547-a6af-06a361d848d8 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:54.766167 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:54.804643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cdb91-22fb-4f54-b4ef-476eb60b1de2 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:54.840074 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:54.854786 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414ab1e-7226-4f81-9ba6-50c7d97e4683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:54.855766 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414ab1e-7226-4f81-9ba6-50c7d97e4683 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:54.856193 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414ab1e-7226-4f81-9ba6-50c7d97e4683 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:54.856616 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414ab1e-7226-4f81-9ba6-50c7d97e4683 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:54.858549 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414ab1e-7226-4f81-9ba6-50c7d97e4683 None admin] RBAC: Adding query filter params (role.id=4fc6ee9bb4ab47abbc8c2e53d38dfadc, scope.project.id=78bf28db88014ad38e46d572425a9c71, user.id=16394eb5a1d24cdfb40754b462f0b85d) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:54.859098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414ab1e-7226-4f81-9ba6-50c7d97e4683 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:54.861495 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414ab1e-7226-4f81-9ba6-50c7d97e4683 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:54.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 150/317] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:24:54 2022] GET /identity/v3/role_assignments?user.id=16394eb5a1d24cdfb40754b462f0b85d&scope.project.id=78bf28db88014ad38e46d572425a9c71&role.id=4fc6ee9bb4ab47abbc8c2e53d38dfadc => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:54.891625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39d129-ad5e-4547-a6af-06a361d848d8 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:54.936888 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa874d-d7ed-42d3-af88-4d7be3721671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:54.937654 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa874d-d7ed-42d3-af88-4d7be3721671 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:54.937944 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa874d-d7ed-42d3-af88-4d7be3721671 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:54.938223 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa874d-d7ed-42d3-af88-4d7be3721671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:54.939109 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa874d-d7ed-42d3-af88-4d7be3721671 None admin] RBAC: Adding query filter params (role.id=4fc6ee9bb4ab47abbc8c2e53d38dfadc, user.id=9d9ae545670a4fe1994124f91a8e1fb8, scope.system=all) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:54.939427 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa874d-d7ed-42d3-af88-4d7be3721671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:54.941045 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa874d-d7ed-42d3-af88-4d7be3721671 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:54.947581 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 168/318] 10.222.0.86 () {56 vars in 1308 bytes} [Fri Jul 15 16:24:54 2022] GET /identity/v3/role_assignments?user.id=9d9ae545670a4fe1994124f91a8e1fb8&scope.system=all&role.id=4fc6ee9bb4ab47abbc8c2e53d38dfadc => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:56.871573 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25338a90-cd94-4773-98d2-6339062ba963 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:56.872012 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25338a90-cd94-4773-98d2-6339062ba963 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:56.872185 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25338a90-cd94-4773-98d2-6339062ba963 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:56.873681 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 151/319] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:56.878720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f1322-9f3a-4a34-a7f9-15bab9596835 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:56.879217 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f1322-9f3a-4a34-a7f9-15bab9596835 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:56.879374 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f1322-9f3a-4a34-a7f9-15bab9596835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:56.896566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-4b1f1322-9f3a-4a34-a7f9-15bab9596835 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:56.897752 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-4b1f1322-9f3a-4a34-a7f9-15bab9596835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:56.938439 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e071af-5497-44f1-b93c-3aac745fa280 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:56.938781 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e071af-5497-44f1-b93c-3aac745fa280 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:56.939068 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e071af-5497-44f1-b93c-3aac745fa280 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:56.940506 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 152/320] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:24:56.945890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d55c0d-dcb8-40f8-b87a-ecc8af249c5f None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:56.946179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d55c0d-dcb8-40f8-b87a-ecc8af249c5f None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:56.946459 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d55c0d-dcb8-40f8-b87a-ecc8af249c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:56.963849 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-31d55c0d-dcb8-40f8-b87a-ecc8af249c5f None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:56.965053 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-31d55c0d-dcb8-40f8-b87a-ecc8af249c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:56.970298 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 169/321] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:56.994202 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f1322-9f3a-4a34-a7f9-15bab9596835 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:56.997296 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:57.049561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 153/322] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:57.074491 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d55c0d-dcb8-40f8-b87a-ecc8af249c5f None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:57.100611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f1322-9f3a-4a34-a7f9-15bab9596835 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:57.138251 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29d70e-5ea7-4191-8eb1-1777b444377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:57.138998 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d70e-5ea7-4191-8eb1-1777b444377d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:57.139279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d70e-5ea7-4191-8eb1-1777b444377d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:57.139557 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d70e-5ea7-4191-8eb1-1777b444377d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:57.140783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29d70e-5ea7-4191-8eb1-1777b444377d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:57.142211 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29d70e-5ea7-4191-8eb1-1777b444377d None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:57.144037 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 170/323] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:24:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:24:57.149253 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29d70e-5ea7-4191-8eb1-1777b444377d None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:57.180729 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d55c0d-dcb8-40f8-b87a-ecc8af249c5f None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:57.199280 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:57.217999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c48d9d-f04e-4973-8504-5962644a9298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:57.219075 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c48d9d-f04e-4973-8504-5962644a9298 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:57.219362 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c48d9d-f04e-4973-8504-5962644a9298 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:57.219632 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c48d9d-f04e-4973-8504-5962644a9298 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:57.220424 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:57.230405 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c48d9d-f04e-4973-8504-5962644a9298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-93c48d9d-f04e-4973-8504-5962644a9298 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:57.238968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:57.239882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:57.240652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:57.240652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:57.240652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:57.240652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:57.240652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:57.240652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:57.240652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:57.240652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:57.240652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:57.240652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:57.240652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:24:57.240652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:57.240652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 154/324] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:57.241600 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fd312-7aea-43ea-85b8-0f97d200e0ca None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:57.241687 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fd312-7aea-43ea-85b8-0f97d200e0ca None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:57.241977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fd312-7aea-43ea-85b8-0f97d200e0ca None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:57.244132 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 155/325] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:24:57.246183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fd312-7aea-43ea-85b8-0f97d200e0ca None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:57.252910 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29d70e-5ea7-4191-8eb1-1777b444377d None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:57.290373 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656f6aa-f556-457c-ac56-658fdd0c5331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:57.291062 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f6aa-f556-457c-ac56-658fdd0c5331 None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:57.291347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f6aa-f556-457c-ac56-658fdd0c5331 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:57.291625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f6aa-f556-457c-ac56-658fdd0c5331 None admin] PATH_INFO: `/v3/groups` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:57.292313 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656f6aa-f556-457c-ac56-658fdd0c5331 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:57.293734 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656f6aa-f556-457c-ac56-658fdd0c5331 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:57.307435 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 171/326] 10.222.0.86 () {60 vars in 1134 bytes} [Fri Jul 15 16:24:57 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 16:24:57.309099 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b79c-b6fc-42d0-a031-dcefcd958c6f None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:57.309393 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b79c-b6fc-42d0-a031-dcefcd958c6f None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:57.309679 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b79c-b6fc-42d0-a031-dcefcd958c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:57.335800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-c9e5b79c-b6fc-42d0-a031-dcefcd958c6f None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:24:57.337151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-c9e5b79c-b6fc-42d0-a031-dcefcd958c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:24:57.363406 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fd312-7aea-43ea-85b8-0f97d200e0ca None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:57.403090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c692d3-7253-4f2b-8406-a43336841378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:57.403724 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c692d3-7253-4f2b-8406-a43336841378 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:57.404013 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c692d3-7253-4f2b-8406-a43336841378 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:57.404323 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c692d3-7253-4f2b-8406-a43336841378 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:57.405088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c692d3-7253-4f2b-8406-a43336841378 None admin] RBAC: Adding query filter params (name=member) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:57.405398 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c692d3-7253-4f2b-8406-a43336841378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:57.406836 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c692d3-7253-4f2b-8406-a43336841378 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:57.414639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 172/327] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:24:57.417241 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 156/328] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:57.424234 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5b79c-b6fc-42d0-a031-dcefcd958c6f None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:57.439147 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c692d3-7253-4f2b-8406-a43336841378 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:57.486742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:57.496446 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:57.545791 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5b79c-b6fc-42d0-a031-dcefcd958c6f None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:57.567403 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c692d3-7253-4f2b-8406-a43336841378 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:57.586649 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff38fa3-a8d9-42bb-8eba-b2049fe9a744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:57.588265 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff38fa3-a8d9-42bb-8eba-b2049fe9a744 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:57.588265 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff38fa3-a8d9-42bb-8eba-b2049fe9a744 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:57.588428 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff38fa3-a8d9-42bb-8eba-b2049fe9a744 None admin] PATH_INFO: `/v3/users/badc62a7a31f40aba0900a781446e4df` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:57.589593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff38fa3-a8d9-42bb-8eba-b2049fe9a744 None admin] RBAC: Authorizing `identity:get_user(user_id=badc62a7a31f40aba0900a781446e4df)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:57.592146 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff38fa3-a8d9-42bb-8eba-b2049fe9a744 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:57.594077 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 173/329] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:57 2022] GET /identity/v3/users/badc62a7a31f40aba0900a781446e4df => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:57.599849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff38fa3-a8d9-42bb-8eba-b2049fe9a744 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:57.607311 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f02f2-5348-4e6e-8f99-9c5c6040e695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:57.608683 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f02f2-5348-4e6e-8f99-9c5c6040e695 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:57.608978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f02f2-5348-4e6e-8f99-9c5c6040e695 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:57.609256 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f02f2-5348-4e6e-8f99-9c5c6040e695 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:57.620065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f02f2-5348-4e6e-8f99-9c5c6040e695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-114f02f2-5348-4e6e-8f99-9c5c6040e695 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:24:57.628662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:24:57.629592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:24:57.630411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:24:57.630411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:24:57.630411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:24:57.630411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:24:57.630411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:24:57.630411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:24:57.630411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:24:57.630411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:24:57.630411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:24:57.630411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:24:57.630411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:24:57.630411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:24:57.630411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 157/330] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:24:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:24:57.635642 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f02f2-5348-4e6e-8f99-9c5c6040e695 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:57.741964 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff38fa3-a8d9-42bb-8eba-b2049fe9a744 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:57.756673 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:57.765046 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f02f2-5348-4e6e-8f99-9c5c6040e695 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:57.779058 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:24:57.786812 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1075a7-ed04-4996-a393-e1b0b7d2cf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:57.787496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1075a7-ed04-4996-a393-e1b0b7d2cf48 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:57.787778 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1075a7-ed04-4996-a393-e1b0b7d2cf48 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:57.788171 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1075a7-ed04-4996-a393-e1b0b7d2cf48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:57.789039 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1075a7-ed04-4996-a393-e1b0b7d2cf48 None admin] RBAC: Adding query filter params (role.id=3bed7bde1b98412b94a181719432cfa1, user.id=badc62a7a31f40aba0900a781446e4df, scope.system=all) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:57.789352 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1075a7-ed04-4996-a393-e1b0b7d2cf48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:57.790997 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1075a7-ed04-4996-a393-e1b0b7d2cf48 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:57.805191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501dfdb-a624-4025-b3b0-1f58597650db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:57.806139 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501dfdb-a624-4025-b3b0-1f58597650db None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:57.806616 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501dfdb-a624-4025-b3b0-1f58597650db None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:57.807145 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501dfdb-a624-4025-b3b0-1f58597650db None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:57.807247 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 174/331] 10.222.0.86 () {56 vars in 1308 bytes} [Fri Jul 15 16:24:57 2022] GET /identity/v3/role_assignments?user.id=badc62a7a31f40aba0900a781446e4df&scope.system=all&role.id=3bed7bde1b98412b94a181719432cfa1 => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:57.808248 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501dfdb-a624-4025-b3b0-1f58597650db None admin] RBAC: Adding query filter params (name=reader) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:24:57.808763 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501dfdb-a624-4025-b3b0-1f58597650db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:57.810324 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501dfdb-a624-4025-b3b0-1f58597650db None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:57.820699 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 158/332] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:24:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:57.826727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1075a7-ed04-4996-a393-e1b0b7d2cf48 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:57.962034 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1075a7-ed04-4996-a393-e1b0b7d2cf48 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:58.003470 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb13d86-09d2-4ae9-b587-3b174ef492d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:58.003668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb13d86-09d2-4ae9-b587-3b174ef492d6 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:58.003828 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb13d86-09d2-4ae9-b587-3b174ef492d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:58.004080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb13d86-09d2-4ae9-b587-3b174ef492d6 None admin] PATH_INFO: `/v3/users/9d9ae545670a4fe1994124f91a8e1fb8` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:58.006001 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb13d86-09d2-4ae9-b587-3b174ef492d6 None admin] RBAC: Authorizing `identity:get_user(user_id=9d9ae545670a4fe1994124f91a8e1fb8)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:58.006778 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb13d86-09d2-4ae9-b587-3b174ef492d6 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:58.008826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 175/333] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:24:57 2022] GET /identity/v3/users/9d9ae545670a4fe1994124f91a8e1fb8 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:24:58.014140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501dfdb-a624-4025-b3b0-1f58597650db None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:24:58.125717 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501dfdb-a624-4025-b3b0-1f58597650db None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:24:58.164163 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0fad7-5f5e-4123-aa48-fbec4e15868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:24:58.165041 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0fad7-5f5e-4123-aa48-fbec4e15868c None admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:58.165328 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0fad7-5f5e-4123-aa48-fbec4e15868c None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:58.165614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0fad7-5f5e-4123-aa48-fbec4e15868c None admin] PATH_INFO: `/v3/system/users/9d9ae545670a4fe1994124f91a8e1fb8/roles/4fc6ee9bb4ab47abbc8c2e53d38dfadc` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:58.167170 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0fad7-5f5e-4123-aa48-fbec4e15868c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9d9ae545670a4fe1994124f91a8e1fb8, role_id=4fc6ee9bb4ab47abbc8c2e53d38dfadc)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:24:58.168560 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0fad7-5f5e-4123-aa48-fbec4e15868c None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:24:58.180958 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 159/334] 10.222.0.86 () {58 vars in 1334 bytes} [Fri Jul 15 16:24:58 2022] PUT /identity/v3/system/users/9d9ae545670a4fe1994124f91a8e1fb8/roles/4fc6ee9bb4ab47abbc8c2e53d38dfadc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 16:24:59.992213 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf5cb4-62dd-408c-b165-21996395030c None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:24:59.992707 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf5cb4-62dd-408c-b165-21996395030c None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:24:59.992781 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf5cb4-62dd-408c-b165-21996395030c None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:24:59.994476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 176/335] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:00.008682 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140a4c7-2c1f-4cef-967b-ca6e64d57135 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:00.009125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140a4c7-2c1f-4cef-967b-ca6e64d57135 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:00.009303 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140a4c7-2c1f-4cef-967b-ca6e64d57135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:00.031642 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-f140a4c7-2c1f-4cef-967b-ca6e64d57135 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:00.032843 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-f140a4c7-2c1f-4cef-967b-ca6e64d57135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:00.052440 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:00.114917 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 160/336] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:00.159871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf5cb4-62dd-408c-b165-21996395030c None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:00.229637 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:00.278679 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf5cb4-62dd-408c-b165-21996395030c None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:00.319623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231af61-01b8-4c86-a2bc-d8075aa08544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:00.320429 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231af61-01b8-4c86-a2bc-d8075aa08544 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:00.320717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231af61-01b8-4c86-a2bc-d8075aa08544 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:00.320996 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231af61-01b8-4c86-a2bc-d8075aa08544 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:00.332673 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231af61-01b8-4c86-a2bc-d8075aa08544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-9231af61-01b8-4c86-a2bc-d8075aa08544 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:00.344856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:00.345746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:00.346545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:00.346545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:00.346545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:00.346545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:00.346545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:00.346545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:00.346545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:00.346545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:00.346545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:00.346545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:00.346545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:25:00.346545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:00.346545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 177/337] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:00.352972 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140a4c7-2c1f-4cef-967b-ca6e64d57135 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:00.469094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140a4c7-2c1f-4cef-967b-ca6e64d57135 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:00.505313 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8650e4c-f004-43de-9a13-fbebc4e9bb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:00.505999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8650e4c-f004-43de-9a13-fbebc4e9bb48 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:00.506292 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8650e4c-f004-43de-9a13-fbebc4e9bb48 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:00.506572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8650e4c-f004-43de-9a13-fbebc4e9bb48 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:00.507360 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8650e4c-f004-43de-9a13-fbebc4e9bb48 None admin] RBAC: Adding query filter params (name=member) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:00.507675 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8650e4c-f004-43de-9a13-fbebc4e9bb48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:00.509143 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8650e4c-f004-43de-9a13-fbebc4e9bb48 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:00.518756 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 161/338] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:25:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:00.524785 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231af61-01b8-4c86-a2bc-d8075aa08544 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:00.537172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861df41-20ba-41c7-b3db-44e25045edcf None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:00.537471 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861df41-20ba-41c7-b3db-44e25045edcf None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:00.537745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861df41-20ba-41c7-b3db-44e25045edcf None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:00.539133 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 162/339] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:00.548309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8596db-4b49-4e7b-9a2d-1b3a6d0d368c None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:00.548598 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8596db-4b49-4e7b-9a2d-1b3a6d0d368c None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:00.548958 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8596db-4b49-4e7b-9a2d-1b3a6d0d368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:00.586981 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-3c8596db-4b49-4e7b-9a2d-1b3a6d0d368c None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:00.590447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-3c8596db-4b49-4e7b-9a2d-1b3a6d0d368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:00.627249 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:00.756063 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 163/340] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:00.771407 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231af61-01b8-4c86-a2bc-d8075aa08544 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:00.802818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:00.806153 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8596db-4b49-4e7b-9a2d-1b3a6d0d368c None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:00.844351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ba54b-579b-4686-b06a-59f3057526c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:00.845410 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ba54b-579b-4686-b06a-59f3057526c1 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:00.845914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ba54b-579b-4686-b06a-59f3057526c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:00.846389 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ba54b-579b-4686-b06a-59f3057526c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:00.942889 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8596db-4b49-4e7b-9a2d-1b3a6d0d368c None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:00.962117 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ba54b-579b-4686-b06a-59f3057526c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:00.964979 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ba54b-579b-4686-b06a-59f3057526c1 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:00.998622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440d519-45ec-4b1b-82b1-1caef5ffb977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:00.999498 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d519-45ec-4b1b-82b1-1caef5ffb977 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:00.999767 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d519-45ec-4b1b-82b1-1caef5ffb977 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:01.000042 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d519-45ec-4b1b-82b1-1caef5ffb977 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:01.030194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440d519-45ec-4b1b-82b1-1caef5ffb977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-9440d519-45ec-4b1b-82b1-1caef5ffb977 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:01.042900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:01.043957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:01.044846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:01.044846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:01.044846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:01.044846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:01.044846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:01.044846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:01.044846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:01.044846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:01.044846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:01.044846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:01.044846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:25:01.044846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:01.044846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 164/341] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:25:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:01.075790 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440d519-45ec-4b1b-82b1-1caef5ffb977 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:01.089802 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:01.112050 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 178/342] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:01.114053 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7adc4f-64f6-4f07-8639-de3309cdcd99 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:01.114575 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7adc4f-64f6-4f07-8639-de3309cdcd99 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:01.115083 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7adc4f-64f6-4f07-8639-de3309cdcd99 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:01.116820 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 179/343] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:01.117732 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7adc4f-64f6-4f07-8639-de3309cdcd99 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:01.157381 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:01.269364 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440d519-45ec-4b1b-82b1-1caef5ffb977 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:01.315004 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fb068-f335-442a-9a68-6ac0bb1e5b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:01.316035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fb068-f335-442a-9a68-6ac0bb1e5b27 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:01.316522 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fb068-f335-442a-9a68-6ac0bb1e5b27 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:01.317013 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fb068-f335-442a-9a68-6ac0bb1e5b27 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:01.318102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fb068-f335-442a-9a68-6ac0bb1e5b27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:01.318668 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fb068-f335-442a-9a68-6ac0bb1e5b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:01.320284 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fb068-f335-442a-9a68-6ac0bb1e5b27 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:01.328569 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7adc4f-64f6-4f07-8639-de3309cdcd99 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:01.330018 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 165/344] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:01.335951 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe441ea-5390-47c5-a23e-1b0ac4c4e2a6 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:01.336675 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe441ea-5390-47c5-a23e-1b0ac4c4e2a6 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:01.337159 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe441ea-5390-47c5-a23e-1b0ac4c4e2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:01.359473 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-8fe441ea-5390-47c5-a23e-1b0ac4c4e2a6 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:01.361035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-8fe441ea-5390-47c5-a23e-1b0ac4c4e2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:01.388636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c033dd-725c-4744-9e23-9ac5e3d3ffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:01.389523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c033dd-725c-4744-9e23-9ac5e3d3ffdb None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:01.389810 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c033dd-725c-4744-9e23-9ac5e3d3ffdb None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:01.390089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c033dd-725c-4744-9e23-9ac5e3d3ffdb None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:01.391653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c033dd-725c-4744-9e23-9ac5e3d3ffdb None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:01.393203 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c033dd-725c-4744-9e23-9ac5e3d3ffdb None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:01.394915 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 180/345] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:25:01 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:01.400116 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c033dd-725c-4744-9e23-9ac5e3d3ffdb None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:01.438892 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:01.440003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 166/346] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:01.440839 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe441ea-5390-47c5-a23e-1b0ac4c4e2a6 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:01.539113 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:01.550178 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe441ea-5390-47c5-a23e-1b0ac4c4e2a6 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:01.562377 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c033dd-725c-4744-9e23-9ac5e3d3ffdb None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:01.591830 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da906f-3044-4482-a9d9-f8f1fd7b6061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:01.593115 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da906f-3044-4482-a9d9-f8f1fd7b6061 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:01.593407 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da906f-3044-4482-a9d9-f8f1fd7b6061 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:01.593703 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da906f-3044-4482-a9d9-f8f1fd7b6061 None admin] PATH_INFO: `/v3/groups/928ef35120844f7a967c38f405c8391b` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:01.603730 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da906f-3044-4482-a9d9-f8f1fd7b6061 None admin] RBAC: Authorizing `identity:get_group(group_id=928ef35120844f7a967c38f405c8391b)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:01.605201 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da906f-3044-4482-a9d9-f8f1fd7b6061 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:01.608021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 167/347] 10.222.0.86 () {56 vars in 1180 bytes} [Fri Jul 15 16:25:01 2022] GET /identity/v3/groups/928ef35120844f7a967c38f405c8391b => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:01.608807 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da906f-3044-4482-a9d9-f8f1fd7b6061 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:01.631254 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399d89f-9c58-4114-95b7-5f0a91ba3323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:01.631960 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399d89f-9c58-4114-95b7-5f0a91ba3323 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:01.632241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399d89f-9c58-4114-95b7-5f0a91ba3323 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:01.632519 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399d89f-9c58-4114-95b7-5f0a91ba3323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:01.711711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:01.713494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399d89f-9c58-4114-95b7-5f0a91ba3323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:01.715218 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399d89f-9c58-4114-95b7-5f0a91ba3323 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:01.756575 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da906f-3044-4482-a9d9-f8f1fd7b6061 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:01.819674 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976dec6-96e5-40eb-887d-e807fa12e8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:01.821358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976dec6-96e5-40eb-887d-e807fa12e8fa None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:01.821846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976dec6-96e5-40eb-887d-e807fa12e8fa None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:01.822672 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976dec6-96e5-40eb-887d-e807fa12e8fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:01.829295 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:01.847784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976dec6-96e5-40eb-887d-e807fa12e8fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-4976dec6-96e5-40eb-887d-e807fa12e8fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:01.856060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:01.857011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:01.857902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:01.857902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:01.857902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:01.857902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:01.857902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:01.857902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:01.857902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:01.857902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:01.857902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:01.857902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:01.857902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:25:01.857902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:01.866508 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 181/348] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:01.866508 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399d89f-9c58-4114-95b7-5f0a91ba3323 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:01.873557 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 168/349] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:01.875291 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17888a09-0822-4469-a40d-84e25e2fd63a None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:01.875808 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17888a09-0822-4469-a40d-84e25e2fd63a None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:01.876291 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17888a09-0822-4469-a40d-84e25e2fd63a None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:01.877795 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 169/350] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:01.878710 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17888a09-0822-4469-a40d-84e25e2fd63a None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:01.990554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399d89f-9c58-4114-95b7-5f0a91ba3323 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:02.033133 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17888a09-0822-4469-a40d-84e25e2fd63a None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:02.035007 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91c933-eb56-447c-95bb-4077af825f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:02.035677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91c933-eb56-447c-95bb-4077af825f6c None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:02.036025 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91c933-eb56-447c-95bb-4077af825f6c None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:02.036303 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91c933-eb56-447c-95bb-4077af825f6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:02.037347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91c933-eb56-447c-95bb-4077af825f6c None admin] RBAC: Adding query filter params (group.id=928ef35120844f7a967c38f405c8391b, role.id=3bed7bde1b98412b94a181719432cfa1, scope.project.id=f26148acb7004ff78333b7b62586ed2e) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:02.037659 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91c933-eb56-447c-95bb-4077af825f6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:02.039976 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91c933-eb56-447c-95bb-4077af825f6c None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:02.046120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 182/351] 10.222.0.86 () {56 vars in 1376 bytes} [Fri Jul 15 16:25:01 2022] GET /identity/v3/role_assignments?group.id=928ef35120844f7a967c38f405c8391b&scope.project.id=f26148acb7004ff78333b7b62586ed2e&role.id=3bed7bde1b98412b94a181719432cfa1 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:02.046980 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91c933-eb56-447c-95bb-4077af825f6c None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:02.077688 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:02.097696 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4642ebb-b936-4ae7-9287-68a5f2cd8c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:02.098648 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4642ebb-b936-4ae7-9287-68a5f2cd8c0e None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:02.098896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4642ebb-b936-4ae7-9287-68a5f2cd8c0e None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:02.099185 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4642ebb-b936-4ae7-9287-68a5f2cd8c0e None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:02.101164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4642ebb-b936-4ae7-9287-68a5f2cd8c0e None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:02.102370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4642ebb-b936-4ae7-9287-68a5f2cd8c0e None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:02.105469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 170/352] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:25:01 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:02.106808 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57785376-239b-45e8-8b1d-e461ab2e14a6 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:02.107122 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57785376-239b-45e8-8b1d-e461ab2e14a6 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:02.107451 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57785376-239b-45e8-8b1d-e461ab2e14a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:02.121642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:02.129039 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-57785376-239b-45e8-8b1d-e461ab2e14a6 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:02.130603 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-57785376-239b-45e8-8b1d-e461ab2e14a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:02.187218 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91c933-eb56-447c-95bb-4077af825f6c None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:02.214069 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 171/353] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:02.215656 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef6280-057e-4d11-8e73-62b76a7c3df9 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:02.215956 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef6280-057e-4d11-8e73-62b76a7c3df9 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:02.216235 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef6280-057e-4d11-8e73-62b76a7c3df9 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:02.218128 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 172/354] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:02.218901 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef6280-057e-4d11-8e73-62b76a7c3df9 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:02.230801 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15139c95-0689-457d-b7db-ad10054a16e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:02.232019 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15139c95-0689-457d-b7db-ad10054a16e4 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:02.232581 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15139c95-0689-457d-b7db-ad10054a16e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:02.233196 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15139c95-0689-457d-b7db-ad10054a16e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:02.234521 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15139c95-0689-457d-b7db-ad10054a16e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:02.235137 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15139c95-0689-457d-b7db-ad10054a16e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:02.236873 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15139c95-0689-457d-b7db-ad10054a16e4 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:02.246825 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 183/355] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:25:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:02.248584 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf7c28-0bd6-4f8d-bad8-bcc2a2832a5c None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:02.249163 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf7c28-0bd6-4f8d-bad8-bcc2a2832a5c None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:02.249731 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf7c28-0bd6-4f8d-bad8-bcc2a2832a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:02.270313 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-ecaf7c28-0bd6-4f8d-bad8-bcc2a2832a5c None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:02.271948 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-ecaf7c28-0bd6-4f8d-bad8-bcc2a2832a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:02.338717 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef6280-057e-4d11-8e73-62b76a7c3df9 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:02.350562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 184/356] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:02.351732 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf7c28-0bd6-4f8d-bad8-bcc2a2832a5c None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:02.371748 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:02.392771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666980b-eb0b-4028-b5d5-55188104dd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:02.393357 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666980b-eb0b-4028-b5d5-55188104dd13 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:02.393639 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666980b-eb0b-4028-b5d5-55188104dd13 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:02.393916 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666980b-eb0b-4028-b5d5-55188104dd13 None admin] PATH_INFO: `/v3/groups/928ef35120844f7a967c38f405c8391b` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:02.395131 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666980b-eb0b-4028-b5d5-55188104dd13 None admin] RBAC: Authorizing `identity:get_group(group_id=928ef35120844f7a967c38f405c8391b)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:02.396596 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666980b-eb0b-4028-b5d5-55188104dd13 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:02.398545 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 173/357] 10.222.0.86 () {56 vars in 1180 bytes} [Fri Jul 15 16:25:02 2022] GET /identity/v3/groups/928ef35120844f7a967c38f405c8391b => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:02.399650 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666980b-eb0b-4028-b5d5-55188104dd13 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:02.401773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:02.478249 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf7c28-0bd6-4f8d-bad8-bcc2a2832a5c None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:02.524365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666980b-eb0b-4028-b5d5-55188104dd13 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:02.532509 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c0695-97ed-4951-ac5d-e655a2de8b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:02.533539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c0695-97ed-4951-ac5d-e655a2de8b58 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:02.534037 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c0695-97ed-4951-ac5d-e655a2de8b58 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:02.535790 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c0695-97ed-4951-ac5d-e655a2de8b58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:02.567444 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e15468-bd70-4c98-8139-7917cb3311c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:02.568253 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e15468-bd70-4c98-8139-7917cb3311c6 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:02.568546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e15468-bd70-4c98-8139-7917cb3311c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:02.568825 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e15468-bd70-4c98-8139-7917cb3311c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:02.583989 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e15468-bd70-4c98-8139-7917cb3311c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-56e15468-bd70-4c98-8139-7917cb3311c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:02.594003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:02.594964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:02.595771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:02.595771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:02.595771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:02.595771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:02.595771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:02.595771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:02.595771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:02.595771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:02.595771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:02.595771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:02.595771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 16:25:02.595771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:02.595771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 174/358] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:02.596435 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e15468-bd70-4c98-8139-7917cb3311c6 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:02.626899 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c0695-97ed-4951-ac5d-e655a2de8b58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:02.628731 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c0695-97ed-4951-ac5d-e655a2de8b58 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:02.653815 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:02.674775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:02.717822 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e15468-bd70-4c98-8139-7917cb3311c6 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:02.749629 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 185/359] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:02.750892 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c0695-97ed-4951-ac5d-e655a2de8b58 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:02.762337 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230297bf-d14b-48cb-9d0a-488cb84b7931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:02.763400 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230297bf-d14b-48cb-9d0a-488cb84b7931 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:02.764449 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230297bf-d14b-48cb-9d0a-488cb84b7931 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:02.764966 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230297bf-d14b-48cb-9d0a-488cb84b7931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:02.766011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230297bf-d14b-48cb-9d0a-488cb84b7931 None admin] RBAC: Adding query filter params (group.id=928ef35120844f7a967c38f405c8391b, role.id=5b22d10db4e647389fd8b36e1bc524fd, scope.project.id=f26148acb7004ff78333b7b62586ed2e) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:02.766601 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230297bf-d14b-48cb-9d0a-488cb84b7931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:02.768838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230297bf-d14b-48cb-9d0a-488cb84b7931 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:02.775258 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 175/360] 10.222.0.86 () {56 vars in 1376 bytes} [Fri Jul 15 16:25:02 2022] GET /identity/v3/role_assignments?group.id=928ef35120844f7a967c38f405c8391b&scope.project.id=f26148acb7004ff78333b7b62586ed2e&role.id=5b22d10db4e647389fd8b36e1bc524fd => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:02.776075 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230297bf-d14b-48cb-9d0a-488cb84b7931 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:02.950022 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230297bf-d14b-48cb-9d0a-488cb84b7931 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:02.950257 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c0695-97ed-4951-ac5d-e655a2de8b58 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:02.966304 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:02.993351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1258de-c07a-421f-afb1-3b1733159973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:02.993768 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1258de-c07a-421f-afb1-3b1733159973 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:02.994041 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1258de-c07a-421f-afb1-3b1733159973 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:02.994324 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1258de-c07a-421f-afb1-3b1733159973 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:02.995597 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609e237-d21e-428d-8ee4-9b915ff3d489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:02.996274 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609e237-d21e-428d-8ee4-9b915ff3d489 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:02.996562 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609e237-d21e-428d-8ee4-9b915ff3d489 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:02.996841 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609e237-d21e-428d-8ee4-9b915ff3d489 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:02.997596 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609e237-d21e-428d-8ee4-9b915ff3d489 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:02.997981 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609e237-d21e-428d-8ee4-9b915ff3d489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:03.000017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609e237-d21e-428d-8ee4-9b915ff3d489 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:03.005568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:03.006383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1258de-c07a-421f-afb1-3b1733159973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:03.009715 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 176/361] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:25:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:03.011253 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf5e48-0702-4952-adf5-eb6c846d91e0 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:03.012043 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf5e48-0702-4952-adf5-eb6c846d91e0 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:03.012579 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf5e48-0702-4952-adf5-eb6c846d91e0 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:03.014194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 177/362] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:03.014774 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf5e48-0702-4952-adf5-eb6c846d91e0 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-5e1258de-c07a-421f-afb1-3b1733159973 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:03.016496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:03.017379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:03.023159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:03.023159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:03.023159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:03.023159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:03.023159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:03.023159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:03.023159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:03.023159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:03.023159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:03.023159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:03.023159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:25:03.023159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:03.023159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 186/363] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:25:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:03.023159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1258de-c07a-421f-afb1-3b1733159973 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:03.131239 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf5e48-0702-4952-adf5-eb6c846d91e0 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:03.136906 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1258de-c07a-421f-afb1-3b1733159973 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:03.167502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b738a-7bfc-4577-a3cd-99c1cf884fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:03.168389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b738a-7bfc-4577-a3cd-99c1cf884fbb None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:03.168700 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b738a-7bfc-4577-a3cd-99c1cf884fbb None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:03.168950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b738a-7bfc-4577-a3cd-99c1cf884fbb None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:03.170797 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b738a-7bfc-4577-a3cd-99c1cf884fbb None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:03.172275 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b738a-7bfc-4577-a3cd-99c1cf884fbb None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:03.174362 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 178/364] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:25:03 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:03.175636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c903191-c91e-4120-b34d-2f51b2381eb3 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:03.175926 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c903191-c91e-4120-b34d-2f51b2381eb3 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:03.176210 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c903191-c91e-4120-b34d-2f51b2381eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:03.176690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55731e05-bc50-420c-a6c2-5ac9b1fe55fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:03.177871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55731e05-bc50-420c-a6c2-5ac9b1fe55fd None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:03.178479 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55731e05-bc50-420c-a6c2-5ac9b1fe55fd None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:03.179042 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55731e05-bc50-420c-a6c2-5ac9b1fe55fd None admin] PATH_INFO: `/v3/users/9d9ae545670a4fe1994124f91a8e1fb8` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:03.180481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55731e05-bc50-420c-a6c2-5ac9b1fe55fd None admin] RBAC: Authorizing `identity:get_user(user_id=9d9ae545670a4fe1994124f91a8e1fb8)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:03.182126 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55731e05-bc50-420c-a6c2-5ac9b1fe55fd None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:03.184009 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 187/365] 10.222.0.86 () {56 vars in 1177 bytes} [Fri Jul 15 16:25:03 2022] GET /identity/v3/users/9d9ae545670a4fe1994124f91a8e1fb8 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:03.184992 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55731e05-bc50-420c-a6c2-5ac9b1fe55fd None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:03.195945 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-6c903191-c91e-4120-b34d-2f51b2381eb3 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:03.197265 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-6c903191-c91e-4120-b34d-2f51b2381eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:03.236930 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:03.258198 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:03.276241 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 179/366] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:03.276903 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c903191-c91e-4120-b34d-2f51b2381eb3 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:03.313471 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55731e05-bc50-420c-a6c2-5ac9b1fe55fd None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:03.353995 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab6ef8-0335-41ea-955b-16a41289c318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:03.354765 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6ef8-0335-41ea-955b-16a41289c318 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:03.355161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6ef8-0335-41ea-955b-16a41289c318 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:03.355518 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6ef8-0335-41ea-955b-16a41289c318 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:03.356345 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab6ef8-0335-41ea-955b-16a41289c318 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:03.356750 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab6ef8-0335-41ea-955b-16a41289c318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:03.358766 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab6ef8-0335-41ea-955b-16a41289c318 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:03.368753 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 188/367] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:03.369752 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab6ef8-0335-41ea-955b-16a41289c318 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:03.391984 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c903191-c91e-4120-b34d-2f51b2381eb3 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:03.438903 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774b01d-8026-4974-8f0f-e01c8ac7e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:03.440030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774b01d-8026-4974-8f0f-e01c8ac7e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:03.440365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774b01d-8026-4974-8f0f-e01c8ac7e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:03.440660 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774b01d-8026-4974-8f0f-e01c8ac7e1c2 None admin] PATH_INFO: `/v3/groups/928ef35120844f7a967c38f405c8391b` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:03.442324 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774b01d-8026-4974-8f0f-e01c8ac7e1c2 None admin] RBAC: Authorizing `identity:get_group(group_id=928ef35120844f7a967c38f405c8391b)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:03.443936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774b01d-8026-4974-8f0f-e01c8ac7e1c2 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:03.446066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 180/368] 10.222.0.86 () {56 vars in 1180 bytes} [Fri Jul 15 16:25:03 2022] GET /identity/v3/groups/928ef35120844f7a967c38f405c8391b => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:03.446854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774b01d-8026-4974-8f0f-e01c8ac7e1c2 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:03.485218 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab6ef8-0335-41ea-955b-16a41289c318 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:03.502717 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:03.536105 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:03.543331 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75490ff1-4077-4824-9c51-c4c5c7ea56e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:03.543999 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75490ff1-4077-4824-9c51-c4c5c7ea56e9 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:03.544288 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75490ff1-4077-4824-9c51-c4c5c7ea56e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:03.544570 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75490ff1-4077-4824-9c51-c4c5c7ea56e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:03.545445 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75490ff1-4077-4824-9c51-c4c5c7ea56e9 None admin] RBAC: Adding query filter params (role.id=4fc6ee9bb4ab47abbc8c2e53d38dfadc, user.id=9d9ae545670a4fe1994124f91a8e1fb8, scope.system=all) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:03.545766 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75490ff1-4077-4824-9c51-c4c5c7ea56e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:03.547460 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75490ff1-4077-4824-9c51-c4c5c7ea56e9 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:03.561089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 189/369] 10.222.0.86 () {56 vars in 1308 bytes} [Fri Jul 15 16:25:03 2022] GET /identity/v3/role_assignments?user.id=9d9ae545670a4fe1994124f91a8e1fb8&scope.system=all&role.id=4fc6ee9bb4ab47abbc8c2e53d38dfadc => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:03.562001 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75490ff1-4077-4824-9c51-c4c5c7ea56e9 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:03.584396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774b01d-8026-4974-8f0f-e01c8ac7e1c2 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:03.642324 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcaf33-2d74-467a-9513-bbaf47ef2bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:03.643173 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcaf33-2d74-467a-9513-bbaf47ef2bfa None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:03.643456 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcaf33-2d74-467a-9513-bbaf47ef2bfa None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:03.643736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcaf33-2d74-467a-9513-bbaf47ef2bfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:03.662180 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcaf33-2d74-467a-9513-bbaf47ef2bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-98fcaf33-2d74-467a-9513-bbaf47ef2bfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:03.672554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:03.673502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:03.674269 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:03.674269 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:03.674269 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:03.674269 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:03.674269 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:03.674269 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:03.674269 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:03.674269 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:03.674269 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:03.674269 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:03.674269 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:25:03.674269 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:03.677014 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 181/370] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:25:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:03.678046 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcaf33-2d74-467a-9513-bbaf47ef2bfa None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:03.719435 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75490ff1-4077-4824-9c51-c4c5c7ea56e9 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:03.759824 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ff94e-ed64-4946-9400-f49b81a9c4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:03.760414 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ff94e-ed64-4946-9400-f49b81a9c4aa None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:03.760704 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ff94e-ed64-4946-9400-f49b81a9c4aa None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:03.760987 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ff94e-ed64-4946-9400-f49b81a9c4aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:03.805262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:03.808602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcaf33-2d74-467a-9513-bbaf47ef2bfa None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:03.835559 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:03.851534 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ff94e-ed64-4946-9400-f49b81a9c4aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:03.852265 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f94321-b08e-4769-95da-ff9961ee359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:03.853131 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f94321-b08e-4769-95da-ff9961ee359a None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:03.853379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ff94e-ed64-4946-9400-f49b81a9c4aa None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:03.853716 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f94321-b08e-4769-95da-ff9961ee359a None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:03.854144 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f94321-b08e-4769-95da-ff9961ee359a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:03.855284 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f94321-b08e-4769-95da-ff9961ee359a None admin] RBAC: Adding query filter params (group.id=928ef35120844f7a967c38f405c8391b, role.id=3bed7bde1b98412b94a181719432cfa1, scope.project.id=78bf28db88014ad38e46d572425a9c71) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:03.855855 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f94321-b08e-4769-95da-ff9961ee359a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:03.868571 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f94321-b08e-4769-95da-ff9961ee359a None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:03.876933 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 182/371] 10.222.0.86 () {56 vars in 1376 bytes} [Fri Jul 15 16:25:03 2022] GET /identity/v3/role_assignments?group.id=928ef35120844f7a967c38f405c8391b&scope.project.id=78bf28db88014ad38e46d572425a9c71&role.id=3bed7bde1b98412b94a181719432cfa1 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:03.878235 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f94321-b08e-4769-95da-ff9961ee359a None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:03.994345 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 190/372] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:04.001000 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ff94e-ed64-4946-9400-f49b81a9c4aa None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:04.089965 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f94321-b08e-4769-95da-ff9961ee359a None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:04.115962 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:04.131579 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ff94e-ed64-4946-9400-f49b81a9c4aa None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:04.172353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc79d28-b20b-4894-8beb-b9ce10a89608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:04.173058 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc79d28-b20b-4894-8beb-b9ce10a89608 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:04.173342 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc79d28-b20b-4894-8beb-b9ce10a89608 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:04.173619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc79d28-b20b-4894-8beb-b9ce10a89608 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:04.174388 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc79d28-b20b-4894-8beb-b9ce10a89608 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:04.174704 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc79d28-b20b-4894-8beb-b9ce10a89608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:04.176135 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc79d28-b20b-4894-8beb-b9ce10a89608 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:04.177286 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa28539-37bc-4ab5-9e36-ed4ced4f0093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:04.178965 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa28539-37bc-4ab5-9e36-ed4ced4f0093 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:04.179467 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa28539-37bc-4ab5-9e36-ed4ced4f0093 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:04.179933 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa28539-37bc-4ab5-9e36-ed4ced4f0093 None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:04.181355 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa28539-37bc-4ab5-9e36-ed4ced4f0093 None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:04.183005 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa28539-37bc-4ab5-9e36-ed4ced4f0093 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:04.190545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 191/373] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:25:03 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:04.192332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa28539-37bc-4ab5-9e36-ed4ced4f0093 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:04.205930 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 183/374] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:04.211858 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc79d28-b20b-4894-8beb-b9ce10a89608 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:04.286444 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:04.324537 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa28539-37bc-4ab5-9e36-ed4ced4f0093 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:04.365291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3584d-0c87-4d06-86fb-32f9268371b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:04.366545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3584d-0c87-4d06-86fb-32f9268371b5 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:04.367071 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3584d-0c87-4d06-86fb-32f9268371b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:04.367598 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3584d-0c87-4d06-86fb-32f9268371b5 None admin] PATH_INFO: `/v3/groups/928ef35120844f7a967c38f405c8391b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:04.370189 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3584d-0c87-4d06-86fb-32f9268371b5 None admin] RBAC: Authorizing `identity:get_group(group_id=928ef35120844f7a967c38f405c8391b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:04.371898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3584d-0c87-4d06-86fb-32f9268371b5 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:04.378715 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 192/375] 10.222.0.86 () {56 vars in 1180 bytes} [Fri Jul 15 16:25:04 2022] GET /identity/v3/groups/928ef35120844f7a967c38f405c8391b => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:04.380281 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3584d-0c87-4d06-86fb-32f9268371b5 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:04.414033 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:04.449778 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc79d28-b20b-4894-8beb-b9ce10a89608 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:04.515998 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4e45f-ad57-452f-b674-cbc3c7667eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:04.517067 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4e45f-ad57-452f-b674-cbc3c7667eb4 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:04.517675 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4e45f-ad57-452f-b674-cbc3c7667eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:04.518163 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4e45f-ad57-452f-b674-cbc3c7667eb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:04.561540 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3584d-0c87-4d06-86fb-32f9268371b5 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:04.604272 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7c140-cd1a-481a-ae0e-5d901b57a23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:04.605291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7c140-cd1a-481a-ae0e-5d901b57a23d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:04.605775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7c140-cd1a-481a-ae0e-5d901b57a23d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:04.606259 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7c140-cd1a-481a-ae0e-5d901b57a23d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:04.608013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7c140-cd1a-481a-ae0e-5d901b57a23d None admin] RBAC: Adding query filter params (group.id=928ef35120844f7a967c38f405c8391b, role.id=5b22d10db4e647389fd8b36e1bc524fd, scope.project.id=78bf28db88014ad38e46d572425a9c71) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:04.608572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7c140-cd1a-481a-ae0e-5d901b57a23d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:04.611065 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7c140-cd1a-481a-ae0e-5d901b57a23d None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:04.618916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 193/376] 10.222.0.86 () {56 vars in 1376 bytes} [Fri Jul 15 16:25:04 2022] GET /identity/v3/role_assignments?group.id=928ef35120844f7a967c38f405c8391b&scope.project.id=78bf28db88014ad38e46d572425a9c71&role.id=5b22d10db4e647389fd8b36e1bc524fd => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:04.642808 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4e45f-ad57-452f-b674-cbc3c7667eb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:04.644706 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4e45f-ad57-452f-b674-cbc3c7667eb4 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:04.677849 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:04.777056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 184/377] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:04.783150 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7c140-cd1a-481a-ae0e-5d901b57a23d None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:04.900345 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:04.926492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7c140-cd1a-481a-ae0e-5d901b57a23d None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:04.977672 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684aa33-6e47-470b-b4df-d6fe13b05b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:04.978560 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684aa33-6e47-470b-b4df-d6fe13b05b28 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:04.978845 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684aa33-6e47-470b-b4df-d6fe13b05b28 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:04.979148 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684aa33-6e47-470b-b4df-d6fe13b05b28 None admin] PATH_INFO: `/v3/projects/fcb5a6ba5f5c46348953f622f9e98380` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:04.980400 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684aa33-6e47-470b-b4df-d6fe13b05b28 None admin] RBAC: Authorizing `identity:get_project(project_id=fcb5a6ba5f5c46348953f622f9e98380)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:04.981982 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684aa33-6e47-470b-b4df-d6fe13b05b28 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:04.988969 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 194/378] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:25:04 2022] GET /identity/v3/projects/fcb5a6ba5f5c46348953f622f9e98380 => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:04.990362 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4e45f-ad57-452f-b674-cbc3c7667eb4 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:05.011681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a2bcf-fec7-4814-bfd7-e32e5f0737bc None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:05.012110 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a2bcf-fec7-4814-bfd7-e32e5f0737bc None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:05.012544 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a2bcf-fec7-4814-bfd7-e32e5f0737bc None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:05.014800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 195/379] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:25:05.021585 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbebeb-a35c-45fa-898c-60d8f0e523bd None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:05.021874 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbebeb-a35c-45fa-898c-60d8f0e523bd None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:05.022425 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbebeb-a35c-45fa-898c-60d8f0e523bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:05.045744 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-d8dbebeb-a35c-45fa-898c-60d8f0e523bd None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:05.047251 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-d8dbebeb-a35c-45fa-898c-60d8f0e523bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:05.119352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4e45f-ad57-452f-b674-cbc3c7667eb4 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:05.136023 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 196/380] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:25:05.162561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:05.175615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996babd-0241-465d-b23e-2afc59389284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:05.176561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996babd-0241-465d-b23e-2afc59389284 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:05.176776 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996babd-0241-465d-b23e-2afc59389284 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:05.177044 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996babd-0241-465d-b23e-2afc59389284 None admin] PATH_INFO: `/v3/groups/abbb3df324044907ba1400444a6a4520` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:05.182716 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996babd-0241-465d-b23e-2afc59389284 None admin] RBAC: Authorizing `identity:get_group(group_id=abbb3df324044907ba1400444a6a4520)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:05.184213 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996babd-0241-465d-b23e-2afc59389284 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:05.188497 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 185/381] 10.222.0.86 () {56 vars in 1180 bytes} [Fri Jul 15 16:25:04 2022] GET /identity/v3/groups/abbb3df324044907ba1400444a6a4520 => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:05.193939 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbebeb-a35c-45fa-898c-60d8f0e523bd None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:05.196187 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996babd-0241-465d-b23e-2afc59389284 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:05.349423 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:05.363495 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996babd-0241-465d-b23e-2afc59389284 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:05.375666 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbebeb-a35c-45fa-898c-60d8f0e523bd None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:05.406795 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cd48b-4657-443e-8586-b48600f3c8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:05.407732 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cd48b-4657-443e-8586-b48600f3c8da None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:05.408026 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cd48b-4657-443e-8586-b48600f3c8da None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:05.408306 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cd48b-4657-443e-8586-b48600f3c8da None admin] PATH_INFO: `/v3/roles/member` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:05.420933 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cd48b-4657-443e-8586-b48600f3c8da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-1a4cd48b-4657-443e-8586-b48600f3c8da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:05.429259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:05.430136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:05.430953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:05.430953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:05.430953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:05.430953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:05.430953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:05.430953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:05.430953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:05.430953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:05.430953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:05.430953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:05.430953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:25:05.430953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:05.430953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 186/382] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:05.435170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698146f-9366-4f4b-91b3-26ec9143738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:05.436027 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698146f-9366-4f4b-91b3-26ec9143738f None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:05.436604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698146f-9366-4f4b-91b3-26ec9143738f None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:05.437068 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698146f-9366-4f4b-91b3-26ec9143738f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:05.437550 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cd48b-4657-443e-8586-b48600f3c8da None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:05.438278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698146f-9366-4f4b-91b3-26ec9143738f None admin] RBAC: Adding query filter params (group.id=abbb3df324044907ba1400444a6a4520, role.id=923dd61feaca45d0933a4601fb2c065b, scope.project.id=fcb5a6ba5f5c46348953f622f9e98380) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:05.438784 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698146f-9366-4f4b-91b3-26ec9143738f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:05.440453 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698146f-9366-4f4b-91b3-26ec9143738f None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:05.450040 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 197/383] 10.222.0.86 () {56 vars in 1376 bytes} [Fri Jul 15 16:25:05 2022] GET /identity/v3/role_assignments?group.id=abbb3df324044907ba1400444a6a4520&scope.project.id=fcb5a6ba5f5c46348953f622f9e98380&role.id=923dd61feaca45d0933a4601fb2c065b => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:05.503273 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:05.575191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cd48b-4657-443e-8586-b48600f3c8da None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:05.624347 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1416f5-e276-4325-8b81-af39c86ea703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:05.625024 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1416f5-e276-4325-8b81-af39c86ea703 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:05.625312 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1416f5-e276-4325-8b81-af39c86ea703 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:05.625590 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1416f5-e276-4325-8b81-af39c86ea703 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:05.626347 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1416f5-e276-4325-8b81-af39c86ea703 None admin] RBAC: Adding query filter params (name=member) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:05.626657 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1416f5-e276-4325-8b81-af39c86ea703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:05.628055 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1416f5-e276-4325-8b81-af39c86ea703 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:05.643765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 187/384] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:25:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:05.649242 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698146f-9366-4f4b-91b3-26ec9143738f None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:05.762733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698146f-9366-4f4b-91b3-26ec9143738f None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:05.803550 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176cb27-4226-40b2-890f-e9dc207004ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:05.804428 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176cb27-4226-40b2-890f-e9dc207004ca None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:05.804713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176cb27-4226-40b2-890f-e9dc207004ca None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:05.804995 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176cb27-4226-40b2-890f-e9dc207004ca None admin] PATH_INFO: `/v3/groups/928ef35120844f7a967c38f405c8391b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:05.806204 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176cb27-4226-40b2-890f-e9dc207004ca None admin] RBAC: Authorizing `identity:get_group(group_id=928ef35120844f7a967c38f405c8391b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:05.807665 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176cb27-4226-40b2-890f-e9dc207004ca None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:05.809607 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 198/385] 10.222.0.86 () {56 vars in 1180 bytes} [Fri Jul 15 16:25:05 2022] GET /identity/v3/groups/928ef35120844f7a967c38f405c8391b => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:05.816693 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1416f5-e276-4325-8b81-af39c86ea703 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:05.926393 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1416f5-e276-4325-8b81-af39c86ea703 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:05.942667 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff1aff-f1ad-47e8-bf87-3edaed0322a7 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:05.943008 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff1aff-f1ad-47e8-bf87-3edaed0322a7 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:05.943279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff1aff-f1ad-47e8-bf87-3edaed0322a7 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:05.944644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 199/386] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:25:05.949806 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:05.951790 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dfa98-e7f0-453a-af33-68b9dca1bc48 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:05.952079 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dfa98-e7f0-453a-af33-68b9dca1bc48 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:05.952363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dfa98-e7f0-453a-af33-68b9dca1bc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:05.972133 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-379dfa98-e7f0-453a-af33-68b9dca1bc48 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:05.973361 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-379dfa98-e7f0-453a-af33-68b9dca1bc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:05.978216 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408ac4e-2ecb-43a6-8a6f-a8769823672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:05.980645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408ac4e-2ecb-43a6-8a6f-a8769823672d None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:05.981143 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408ac4e-2ecb-43a6-8a6f-a8769823672d None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:05.981614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408ac4e-2ecb-43a6-8a6f-a8769823672d None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:05.983510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408ac4e-2ecb-43a6-8a6f-a8769823672d None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:05.985682 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408ac4e-2ecb-43a6-8a6f-a8769823672d None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:05.988400 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 188/387] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:25:05 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:05.993011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:05.994826 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408ac4e-2ecb-43a6-8a6f-a8769823672d None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:06.061564 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 200/388] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:25:06.087168 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379dfa98-e7f0-453a-af33-68b9dca1bc48 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:06.129325 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408ac4e-2ecb-43a6-8a6f-a8769823672d None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:06.165662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1dfc32-c569-4d93-b522-5e31b7b7679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:06.166637 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dfc32-c569-4d93-b522-5e31b7b7679c None admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:06.166886 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dfc32-c569-4d93-b522-5e31b7b7679c None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:06.167172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dfc32-c569-4d93-b522-5e31b7b7679c None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e/groups/928ef35120844f7a967c38f405c8391b/roles/3bed7bde1b98412b94a181719432cfa1` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:06.169233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1dfc32-c569-4d93-b522-5e31b7b7679c None admin] RBAC: Authorizing `identity:create_grant(project_id=f26148acb7004ff78333b7b62586ed2e, group_id=928ef35120844f7a967c38f405c8391b, role_id=3bed7bde1b98412b94a181719432cfa1)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:06.170646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1dfc32-c569-4d93-b522-5e31b7b7679c None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:06.189459 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 189/389] 10.222.0.86 () {58 vars in 1442 bytes} [Fri Jul 15 16:25:05 2022] PUT /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e/groups/928ef35120844f7a967c38f405c8391b/roles/3bed7bde1b98412b94a181719432cfa1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:25:06.222735 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379dfa98-e7f0-453a-af33-68b9dca1bc48 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:06.269148 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17626c01-8604-4606-b8d7-b6611003d9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:06.270330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17626c01-8604-4606-b8d7-b6611003d9f8 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:06.270843 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17626c01-8604-4606-b8d7-b6611003d9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:06.271388 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17626c01-8604-4606-b8d7-b6611003d9f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:06.285910 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17626c01-8604-4606-b8d7-b6611003d9f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-17626c01-8604-4606-b8d7-b6611003d9f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:06.295526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:06.296712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:06.297764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:06.297764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:06.297764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:06.297764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:06.297764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:06.297764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:06.297764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:06.297764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:06.297764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:06.297764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:06.297764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:25:06.297764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:06.304506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 201/390] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:06.310533 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1dfc32-c569-4d93-b522-5e31b7b7679c None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:06.372448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:06.438614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1dfc32-c569-4d93-b522-5e31b7b7679c None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:06.475995 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a3aaa-14ac-472a-8b30-b34c39cb1fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:06.476681 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a3aaa-14ac-472a-8b30-b34c39cb1fc8 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:06.477034 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a3aaa-14ac-472a-8b30-b34c39cb1fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:06.477311 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a3aaa-14ac-472a-8b30-b34c39cb1fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:06.478114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a3aaa-14ac-472a-8b30-b34c39cb1fc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:06.478430 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a3aaa-14ac-472a-8b30-b34c39cb1fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:06.479840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a3aaa-14ac-472a-8b30-b34c39cb1fc8 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:06.489817 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 190/391] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:06.495424 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17626c01-8604-4606-b8d7-b6611003d9f8 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:06.509872 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:06.610021 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17626c01-8604-4606-b8d7-b6611003d9f8 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:06.657154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16a5a0-00f9-42f9-9e70-7459d4c07544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:06.657937 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16a5a0-00f9-42f9-9e70-7459d4c07544 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:06.658276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16a5a0-00f9-42f9-9e70-7459d4c07544 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:06.658559 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16a5a0-00f9-42f9-9e70-7459d4c07544 None admin] PATH_INFO: `/v3/groups/928ef35120844f7a967c38f405c8391b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:06.663595 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16a5a0-00f9-42f9-9e70-7459d4c07544 None admin] RBAC: Authorizing `identity:get_group(group_id=928ef35120844f7a967c38f405c8391b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:06.665073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16a5a0-00f9-42f9-9e70-7459d4c07544 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:06.666692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 202/392] 10.222.0.86 () {56 vars in 1180 bytes} [Fri Jul 15 16:25:06 2022] GET /identity/v3/groups/928ef35120844f7a967c38f405c8391b => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:06.672847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a3aaa-14ac-472a-8b30-b34c39cb1fc8 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:06.824593 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a3aaa-14ac-472a-8b30-b34c39cb1fc8 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:06.826908 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:06.867571 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22494d-687d-4c90-9e73-60b983446381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:06.868417 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22494d-687d-4c90-9e73-60b983446381 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:06.868689 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22494d-687d-4c90-9e73-60b983446381 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:06.868970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22494d-687d-4c90-9e73-60b983446381 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:06.870171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22494d-687d-4c90-9e73-60b983446381 None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:06.871720 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22494d-687d-4c90-9e73-60b983446381 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:06.877066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 191/393] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:25:06 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:06.882420 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16a5a0-00f9-42f9-9e70-7459d4c07544 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:07.004955 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:07.031860 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16a5a0-00f9-42f9-9e70-7459d4c07544 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:07.080496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee4372-235b-46dd-a4f2-4e6adb4efe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:07.081394 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee4372-235b-46dd-a4f2-4e6adb4efe67 None admin] REQUEST_METHOD: `PUT` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:07.081684 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee4372-235b-46dd-a4f2-4e6adb4efe67 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:07.081964 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee4372-235b-46dd-a4f2-4e6adb4efe67 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e/groups/928ef35120844f7a967c38f405c8391b/roles/5b22d10db4e647389fd8b36e1bc524fd` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:07.084298 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee4372-235b-46dd-a4f2-4e6adb4efe67 None admin] RBAC: Authorizing `identity:create_grant(project_id=f26148acb7004ff78333b7b62586ed2e, group_id=928ef35120844f7a967c38f405c8391b, role_id=5b22d10db4e647389fd8b36e1bc524fd)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:07.085770 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee4372-235b-46dd-a4f2-4e6adb4efe67 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:07.116659 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 203/394] 10.222.0.86 () {58 vars in 1442 bytes} [Fri Jul 15 16:25:06 2022] PUT /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e/groups/928ef35120844f7a967c38f405c8391b/roles/5b22d10db4e647389fd8b36e1bc524fd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:25:07.193920 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc347ec-cc50-4f01-bc2d-50582e8c760d None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:07.194420 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc347ec-cc50-4f01-bc2d-50582e8c760d None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:07.194494 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc347ec-cc50-4f01-bc2d-50582e8c760d None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:07.196649 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 192/395] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:07.203440 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3adce6-131b-4857-ab4b-64045d7e1eeb None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:07.203728 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3adce6-131b-4857-ab4b-64045d7e1eeb None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:07.204016 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3adce6-131b-4857-ab4b-64045d7e1eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:07.221950 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-5d3adce6-131b-4857-ab4b-64045d7e1eeb None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:07.223198 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-5d3adce6-131b-4857-ab4b-64045d7e1eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:07.302366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 204/396] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:07.329335 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc347ec-cc50-4f01-bc2d-50582e8c760d None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:07.477285 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc347ec-cc50-4f01-bc2d-50582e8c760d None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:07.517619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9c77c-6b4a-4cbd-a57d-2a686c3e82a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:07.518432 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9c77c-6b4a-4cbd-a57d-2a686c3e82a6 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:07.518711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9c77c-6b4a-4cbd-a57d-2a686c3e82a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:07.519016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9c77c-6b4a-4cbd-a57d-2a686c3e82a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:07.531021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9c77c-6b4a-4cbd-a57d-2a686c3e82a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-69e9c77c-6b4a-4cbd-a57d-2a686c3e82a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:07.539112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:07.540065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:07.540838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:07.540838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:07.540838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:07.540838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:07.540838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:07.540838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:07.540838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:07.540838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:07.540838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:07.540838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:07.540838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:25:07.540838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:07.540838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 193/397] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:07.547191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3adce6-131b-4857-ab4b-64045d7e1eeb None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:07.618138 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:07.656401 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3adce6-131b-4857-ab4b-64045d7e1eeb None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:07.696931 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce5d6d-4863-44b5-bdc0-595bff0231ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:07.697604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5d6d-4863-44b5-bdc0-595bff0231ca None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:07.697885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5d6d-4863-44b5-bdc0-595bff0231ca None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:07.698156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5d6d-4863-44b5-bdc0-595bff0231ca None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:07.698932 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce5d6d-4863-44b5-bdc0-595bff0231ca None admin] RBAC: Adding query filter params (name=member) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:07.699228 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce5d6d-4863-44b5-bdc0-595bff0231ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:07.700587 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce5d6d-4863-44b5-bdc0-595bff0231ca None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:07.711691 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 205/398] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:25:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:07.717622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9c77c-6b4a-4cbd-a57d-2a686c3e82a6 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:07.729113 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8140fef-b489-483c-a507-46366d397933 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:07.729406 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8140fef-b489-483c-a507-46366d397933 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:07.729682 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8140fef-b489-483c-a507-46366d397933 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:07.731337 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 206/399] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:07.744659 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d70b35-7dc3-4c59-9c97-c9027b99b1e3 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:07.744945 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d70b35-7dc3-4c59-9c97-c9027b99b1e3 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:07.745228 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d70b35-7dc3-4c59-9c97-c9027b99b1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:07.759654 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:07.776040 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-c0d70b35-7dc3-4c59-9c97-c9027b99b1e3 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:07.779157 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-c0d70b35-7dc3-4c59-9c97-c9027b99b1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:07.884057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9c77c-6b4a-4cbd-a57d-2a686c3e82a6 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:07.910975 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 207/400] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:25:07.948154 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abf573-c46f-42d8-b4e1-d165c6f74be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:07.949031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abf573-c46f-42d8-b4e1-d165c6f74be5 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:07.949321 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abf573-c46f-42d8-b4e1-d165c6f74be5 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:07.949598 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abf573-c46f-42d8-b4e1-d165c6f74be5 None admin] PATH_INFO: `/v3/groups/928ef35120844f7a967c38f405c8391b` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:07.951792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abf573-c46f-42d8-b4e1-d165c6f74be5 None admin] RBAC: Authorizing `identity:get_group(group_id=928ef35120844f7a967c38f405c8391b)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:07.953409 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abf573-c46f-42d8-b4e1-d165c6f74be5 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:07.957268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 194/401] 10.222.0.86 () {56 vars in 1180 bytes} [Fri Jul 15 16:25:07 2022] GET /identity/v3/groups/928ef35120844f7a967c38f405c8391b => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:07.960995 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d70b35-7dc3-4c59-9c97-c9027b99b1e3 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:07.973085 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abf573-c46f-42d8-b4e1-d165c6f74be5 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:08.071239 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:08.136563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d70b35-7dc3-4c59-9c97-c9027b99b1e3 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:08.159258 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:08.161703 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abf573-c46f-42d8-b4e1-d165c6f74be5 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:08.201216 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ee75d-100f-46dc-b2da-74b8976bf909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:08.202343 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ee75d-100f-46dc-b2da-74b8976bf909 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:08.202823 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ee75d-100f-46dc-b2da-74b8976bf909 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:08.203257 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ee75d-100f-46dc-b2da-74b8976bf909 None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:08.205802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ee75d-100f-46dc-b2da-74b8976bf909 None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:08.207449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ee75d-100f-46dc-b2da-74b8976bf909 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:08.215202 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 208/402] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:25:07 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:08.219779 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ee75d-100f-46dc-b2da-74b8976bf909 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:08.236197 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1598ff-14b8-478f-8e04-da2e2505aee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:08.237643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1598ff-14b8-478f-8e04-da2e2505aee0 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:08.238078 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1598ff-14b8-478f-8e04-da2e2505aee0 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:08.238510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1598ff-14b8-478f-8e04-da2e2505aee0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:08.259143 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1598ff-14b8-478f-8e04-da2e2505aee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-8b1598ff-14b8-478f-8e04-da2e2505aee0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:08.271233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:08.272341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:08.273436 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:08.273436 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:08.273436 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:08.273436 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:08.273436 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:08.273436 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:08.273436 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:08.273436 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:08.273436 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:08.273436 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:08.273436 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:25:08.273436 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:08.281250 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 195/403] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:25:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:08.285993 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1598ff-14b8-478f-8e04-da2e2505aee0 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:08.405971 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ee75d-100f-46dc-b2da-74b8976bf909 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:08.477869 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:08.509334 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218478d-2b1b-4436-b624-2e63620d5987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:08.510488 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218478d-2b1b-4436-b624-2e63620d5987 None admin] REQUEST_METHOD: `PUT` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:08.510990 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218478d-2b1b-4436-b624-2e63620d5987 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:08.511615 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218478d-2b1b-4436-b624-2e63620d5987 None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71/groups/928ef35120844f7a967c38f405c8391b/roles/3bed7bde1b98412b94a181719432cfa1` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:08.514015 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218478d-2b1b-4436-b624-2e63620d5987 None admin] RBAC: Authorizing `identity:create_grant(project_id=78bf28db88014ad38e46d572425a9c71, group_id=928ef35120844f7a967c38f405c8391b, role_id=3bed7bde1b98412b94a181719432cfa1)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:08.517192 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1598ff-14b8-478f-8e04-da2e2505aee0 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:08.520583 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218478d-2b1b-4436-b624-2e63620d5987 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:08.569740 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 209/404] 10.222.0.86 () {58 vars in 1442 bytes} [Fri Jul 15 16:25:08 2022] PUT /identity/v3/projects/78bf28db88014ad38e46d572425a9c71/groups/928ef35120844f7a967c38f405c8391b/roles/3bed7bde1b98412b94a181719432cfa1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:25:08.626103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83a06c-2a15-4d1b-a455-4b136f0fd310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:08.627086 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83a06c-2a15-4d1b-a455-4b136f0fd310 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:08.627654 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83a06c-2a15-4d1b-a455-4b136f0fd310 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:08.628107 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83a06c-2a15-4d1b-a455-4b136f0fd310 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:08.629078 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83a06c-2a15-4d1b-a455-4b136f0fd310 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:08.629556 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83a06c-2a15-4d1b-a455-4b136f0fd310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:08.631105 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83a06c-2a15-4d1b-a455-4b136f0fd310 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:08.653428 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 196/405] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:08.660528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218478d-2b1b-4436-b624-2e63620d5987 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:08.714213 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b3798-dc5a-47f8-9da6-359eb84e90d8 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:08.714738 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b3798-dc5a-47f8-9da6-359eb84e90d8 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:08.715202 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b3798-dc5a-47f8-9da6-359eb84e90d8 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:08.717141 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 197/406] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:08.726854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53723075-3a7b-44f0-bb77-89ad9696a7df None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:08.727224 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53723075-3a7b-44f0-bb77-89ad9696a7df None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:08.727663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53723075-3a7b-44f0-bb77-89ad9696a7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:08.758949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-53723075-3a7b-44f0-bb77-89ad9696a7df None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:08.761774 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-53723075-3a7b-44f0-bb77-89ad9696a7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:08.798118 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:08.878381 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218478d-2b1b-4436-b624-2e63620d5987 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:08.922763 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 198/407] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:08.930585 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec2f4f-0054-4dc3-9b59-ba09573e70ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:08.932745 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec2f4f-0054-4dc3-9b59-ba09573e70ff None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:08.933198 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec2f4f-0054-4dc3-9b59-ba09573e70ff None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:08.933576 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec2f4f-0054-4dc3-9b59-ba09573e70ff None admin] PATH_INFO: `/v3/groups/928ef35120844f7a967c38f405c8391b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:08.935857 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec2f4f-0054-4dc3-9b59-ba09573e70ff None admin] RBAC: Authorizing `identity:get_group(group_id=928ef35120844f7a967c38f405c8391b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:08.937429 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec2f4f-0054-4dc3-9b59-ba09573e70ff None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:08.939639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 210/408] 10.222.0.86 () {56 vars in 1180 bytes} [Fri Jul 15 16:25:08 2022] GET /identity/v3/groups/928ef35120844f7a967c38f405c8391b => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:08.946901 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53723075-3a7b-44f0-bb77-89ad9696a7df None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:08.950683 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec2f4f-0054-4dc3-9b59-ba09573e70ff None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:09.100939 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:09.153990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53723075-3a7b-44f0-bb77-89ad9696a7df None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:09.202647 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec2f4f-0054-4dc3-9b59-ba09573e70ff None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:09.239638 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743d3a4-aecd-4132-aaea-8ae18e75c9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:09.241573 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743d3a4-aecd-4132-aaea-8ae18e75c9f1 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:09.241573 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743d3a4-aecd-4132-aaea-8ae18e75c9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:09.241573 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743d3a4-aecd-4132-aaea-8ae18e75c9f1 None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:09.242209 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743d3a4-aecd-4132-aaea-8ae18e75c9f1 None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:09.243674 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743d3a4-aecd-4132-aaea-8ae18e75c9f1 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:09.246888 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 199/409] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:25:08 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:09.251599 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743d3a4-aecd-4132-aaea-8ae18e75c9f1 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:09.273866 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:09.284945 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62700acd-99d9-4558-9552-891706a6583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:09.286067 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62700acd-99d9-4558-9552-891706a6583e None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:09.286596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62700acd-99d9-4558-9552-891706a6583e None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:09.287131 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62700acd-99d9-4558-9552-891706a6583e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:09.315731 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62700acd-99d9-4558-9552-891706a6583e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-62700acd-99d9-4558-9552-891706a6583e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:09.331988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:09.332916 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:09.333727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:09.333727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:09.333727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:09.333727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:09.333727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:09.333727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:09.333727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:09.333727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:09.333727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:09.333727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:09.333727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:25:09.333727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:09.336457 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 211/410] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:25:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:09.342570 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62700acd-99d9-4558-9552-891706a6583e None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:09.368089 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743d3a4-aecd-4132-aaea-8ae18e75c9f1 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:09.411955 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b515b5-adb5-4272-8848-a05cc440429b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:09.412909 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b515b5-adb5-4272-8848-a05cc440429b None admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:09.413194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b515b5-adb5-4272-8848-a05cc440429b None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:09.413467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b515b5-adb5-4272-8848-a05cc440429b None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71/groups/928ef35120844f7a967c38f405c8391b/roles/5b22d10db4e647389fd8b36e1bc524fd` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:09.416682 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b515b5-adb5-4272-8848-a05cc440429b None admin] RBAC: Authorizing `identity:create_grant(project_id=78bf28db88014ad38e46d572425a9c71, group_id=928ef35120844f7a967c38f405c8391b, role_id=5b22d10db4e647389fd8b36e1bc524fd)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:09.418897 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b515b5-adb5-4272-8848-a05cc440429b None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:09.436452 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 200/411] 10.222.0.86 () {58 vars in 1442 bytes} [Fri Jul 15 16:25:09 2022] PUT /identity/v3/projects/78bf28db88014ad38e46d572425a9c71/groups/928ef35120844f7a967c38f405c8391b/roles/5b22d10db4e647389fd8b36e1bc524fd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:25:09.437844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff6d35-a2cd-4a51-a55e-a32a12abc2e0 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:09.438131 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff6d35-a2cd-4a51-a55e-a32a12abc2e0 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:09.438412 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff6d35-a2cd-4a51-a55e-a32a12abc2e0 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:09.440062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 201/412] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:09.457051 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed57fc-4e57-455d-acb4-9837a994494d None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:09.457241 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed57fc-4e57-455d-acb4-9837a994494d None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:09.457512 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed57fc-4e57-455d-acb4-9837a994494d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:09.482839 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62700acd-99d9-4558-9552-891706a6583e None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:09.496260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-b8ed57fc-4e57-455d-acb4-9837a994494d None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:09.497481 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-b8ed57fc-4e57-455d-acb4-9837a994494d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:09.516894 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:09.565493 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64643c-ac87-4009-b004-8adc5c6407ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:09.566172 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64643c-ac87-4009-b004-8adc5c6407ae None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:09.566456 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64643c-ac87-4009-b004-8adc5c6407ae None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:09.566731 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64643c-ac87-4009-b004-8adc5c6407ae None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:09.567524 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64643c-ac87-4009-b004-8adc5c6407ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:09.567828 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64643c-ac87-4009-b004-8adc5c6407ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:09.569223 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64643c-ac87-4009-b004-8adc5c6407ae None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:09.594052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 212/413] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:09.601578 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64643c-ac87-4009-b004-8adc5c6407ae None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:09.631749 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 202/414] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:25:09.671517 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed57fc-4e57-455d-acb4-9837a994494d None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:09.682202 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:09.746004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64643c-ac87-4009-b004-8adc5c6407ae None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:09.799649 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d96df2-3ef8-49f5-bdb8-1860766c5f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:09.801309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d96df2-3ef8-49f5-bdb8-1860766c5f93 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:09.801924 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d96df2-3ef8-49f5-bdb8-1860766c5f93 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:09.803910 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed57fc-4e57-455d-acb4-9837a994494d None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:09.804347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d96df2-3ef8-49f5-bdb8-1860766c5f93 None admin] PATH_INFO: `/v3/groups/abbb3df324044907ba1400444a6a4520` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:09.806971 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d96df2-3ef8-49f5-bdb8-1860766c5f93 None admin] RBAC: Authorizing `identity:get_group(group_id=abbb3df324044907ba1400444a6a4520)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:09.808572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d96df2-3ef8-49f5-bdb8-1860766c5f93 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:09.819408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 213/415] 10.222.0.86 () {56 vars in 1180 bytes} [Fri Jul 15 16:25:09 2022] GET /identity/v3/groups/abbb3df324044907ba1400444a6a4520 => generated 229 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:09.822202 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d96df2-3ef8-49f5-bdb8-1860766c5f93 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:09.875395 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:09.919654 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958fea8-d0f8-4c77-9d64-e49f4d7848c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:09.920970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958fea8-d0f8-4c77-9d64-e49f4d7848c5 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:09.921278 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958fea8-d0f8-4c77-9d64-e49f4d7848c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:09.921515 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958fea8-d0f8-4c77-9d64-e49f4d7848c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:09.936155 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d96df2-3ef8-49f5-bdb8-1860766c5f93 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:09.952011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958fea8-d0f8-4c77-9d64-e49f4d7848c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-2958fea8-d0f8-4c77-9d64-e49f4d7848c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:09.967950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:09.969056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:09.970031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:09.970031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:09.970031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:09.970031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:09.970031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:09.970031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:09.970031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:09.970031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:09.970031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:09.970031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:09.970031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:25:09.970031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:09.970031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 203/416] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:09.977598 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958fea8-d0f8-4c77-9d64-e49f4d7848c5 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:09.979279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f0981-2034-47bb-9189-794d153f896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:09.980427 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f0981-2034-47bb-9189-794d153f896e None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:09.980788 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f0981-2034-47bb-9189-794d153f896e None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:09.981163 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f0981-2034-47bb-9189-794d153f896e None admin] PATH_INFO: `/v3/projects/fcb5a6ba5f5c46348953f622f9e98380` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:09.983064 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f0981-2034-47bb-9189-794d153f896e None admin] RBAC: Authorizing `identity:get_project(project_id=fcb5a6ba5f5c46348953f622f9e98380)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:09.985499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f0981-2034-47bb-9189-794d153f896e None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:09.987436 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 214/417] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:25:09 2022] GET /identity/v3/projects/fcb5a6ba5f5c46348953f622f9e98380 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:09.993690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f0981-2034-47bb-9189-794d153f896e None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:10.119374 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:10.121779 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f0981-2034-47bb-9189-794d153f896e None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:10.137749 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:10.174346 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958fea8-d0f8-4c77-9d64-e49f4d7848c5 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:10.184200 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845d71b-8afe-471d-9866-392cafba9551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:10.185092 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845d71b-8afe-471d-9866-392cafba9551 None admin] REQUEST_METHOD: `PUT` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:10.185420 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845d71b-8afe-471d-9866-392cafba9551 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:10.185700 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845d71b-8afe-471d-9866-392cafba9551 None admin] PATH_INFO: `/v3/projects/fcb5a6ba5f5c46348953f622f9e98380/groups/abbb3df324044907ba1400444a6a4520/roles/923dd61feaca45d0933a4601fb2c065b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:10.189548 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845d71b-8afe-471d-9866-392cafba9551 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcb5a6ba5f5c46348953f622f9e98380, group_id=abbb3df324044907ba1400444a6a4520, role_id=923dd61feaca45d0933a4601fb2c065b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:10.191315 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845d71b-8afe-471d-9866-392cafba9551 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:10.214129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 215/418] 10.222.0.86 () {58 vars in 1442 bytes} [Fri Jul 15 16:25:09 2022] PUT /identity/v3/projects/fcb5a6ba5f5c46348953f622f9e98380/groups/abbb3df324044907ba1400444a6a4520/roles/923dd61feaca45d0933a4601fb2c065b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:25:10.222103 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74d6b1-86b9-45a8-afa5-4bbf129c9486 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:10.222400 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74d6b1-86b9-45a8-afa5-4bbf129c9486 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:10.222667 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74d6b1-86b9-45a8-afa5-4bbf129c9486 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:10.224460 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 216/419] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:25:10.234348 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530d70a-5df3-40d9-8d88-894a5a692207 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:10.234656 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530d70a-5df3-40d9-8d88-894a5a692207 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:10.234927 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530d70a-5df3-40d9-8d88-894a5a692207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:10.245478 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8515ca-ca83-4e53-9c4a-72b6fdfd61fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:10.247341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8515ca-ca83-4e53-9c4a-72b6fdfd61fd None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:10.247634 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8515ca-ca83-4e53-9c4a-72b6fdfd61fd None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:10.247963 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8515ca-ca83-4e53-9c4a-72b6fdfd61fd None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:10.248934 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8515ca-ca83-4e53-9c4a-72b6fdfd61fd None admin] RBAC: Adding query filter params (name=member) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:10.249322 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8515ca-ca83-4e53-9c4a-72b6fdfd61fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:10.252621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8515ca-ca83-4e53-9c4a-72b6fdfd61fd None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:10.272143 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 204/420] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:25:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:10.275020 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-d530d70a-5df3-40d9-8d88-894a5a692207 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:10.276397 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-d530d70a-5df3-40d9-8d88-894a5a692207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:10.278536 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8515ca-ca83-4e53-9c4a-72b6fdfd61fd None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:10.409772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 217/421] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:10.434996 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530d70a-5df3-40d9-8d88-894a5a692207 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:10.449528 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8515ca-ca83-4e53-9c4a-72b6fdfd61fd None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:10.485189 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:10.494427 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f1be0-0b2f-4d04-a960-43e1d9c9592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:10.495122 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f1be0-0b2f-4d04-a960-43e1d9c9592c None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:10.495452 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f1be0-0b2f-4d04-a960-43e1d9c9592c None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:10.495735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f1be0-0b2f-4d04-a960-43e1d9c9592c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:10.554313 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530d70a-5df3-40d9-8d88-894a5a692207 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:10.556815 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:10.586665 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f1be0-0b2f-4d04-a960-43e1d9c9592c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:10.588424 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f1be0-0b2f-4d04-a960-43e1d9c9592c None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:10.599164 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe4ae9-3e2e-40bc-82e2-38d6d33adfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:10.600315 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe4ae9-3e2e-40bc-82e2-38d6d33adfac None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:10.600859 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe4ae9-3e2e-40bc-82e2-38d6d33adfac None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:10.601361 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe4ae9-3e2e-40bc-82e2-38d6d33adfac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:10.613471 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe4ae9-3e2e-40bc-82e2-38d6d33adfac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-edbe4ae9-3e2e-40bc-82e2-38d6d33adfac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:10.623562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:10.624487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:10.625293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:10.625293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:10.625293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:10.625293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:10.625293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:10.625293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:10.625293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:10.625293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:10.625293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:10.625293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:10.625293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:25:10.625293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:10.628072 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 218/422] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:25:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:10.634410 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe4ae9-3e2e-40bc-82e2-38d6d33adfac None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:10.709103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 205/423] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 16:25:10.714334 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f1be0-0b2f-4d04-a960-43e1d9c9592c None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:10.757486 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:10.813751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe4ae9-3e2e-40bc-82e2-38d6d33adfac None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:10.840684 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f1be0-0b2f-4d04-a960-43e1d9c9592c None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:10.894253 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c871a4f-2286-4c02-b4bb-615867d9fa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:10.895157 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c871a4f-2286-4c02-b4bb-615867d9fa03 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:10.895439 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c871a4f-2286-4c02-b4bb-615867d9fa03 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:10.895717 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c871a4f-2286-4c02-b4bb-615867d9fa03 None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:10.898173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bbbf1-2424-4922-a7e5-eaf0a2b6c8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:10.898837 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bbbf1-2424-4922-a7e5-eaf0a2b6c8a1 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:10.899144 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bbbf1-2424-4922-a7e5-eaf0a2b6c8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:10.899420 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bbbf1-2424-4922-a7e5-eaf0a2b6c8a1 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:10.900179 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bbbf1-2424-4922-a7e5-eaf0a2b6c8a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:10.900586 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bbbf1-2424-4922-a7e5-eaf0a2b6c8a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:10.901963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bbbf1-2424-4922-a7e5-eaf0a2b6c8a1 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:10.904020 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c871a4f-2286-4c02-b4bb-615867d9fa03 None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:10.905458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c871a4f-2286-4c02-b4bb-615867d9fa03 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:10.908450 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 206/424] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:25:10 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:10.912669 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c871a4f-2286-4c02-b4bb-615867d9fa03 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:10.918269 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 219/425] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:10.925621 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bbbf1-2424-4922-a7e5-eaf0a2b6c8a1 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:10.976466 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:11.104430 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:11.107383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c871a4f-2286-4c02-b4bb-615867d9fa03 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:11.137023 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bbbf1-2424-4922-a7e5-eaf0a2b6c8a1 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:11.149535 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614763a3-acc3-4d3c-97c8-6f5f6fc1aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:11.150430 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614763a3-acc3-4d3c-97c8-6f5f6fc1aca4 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:11.150713 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614763a3-acc3-4d3c-97c8-6f5f6fc1aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:11.151104 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614763a3-acc3-4d3c-97c8-6f5f6fc1aca4 None admin] PATH_INFO: `/v3/groups/928ef35120844f7a967c38f405c8391b` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:11.152653 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614763a3-acc3-4d3c-97c8-6f5f6fc1aca4 None admin] RBAC: Authorizing `identity:get_group(group_id=928ef35120844f7a967c38f405c8391b)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:11.154590 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614763a3-acc3-4d3c-97c8-6f5f6fc1aca4 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:11.156715 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 207/426] 10.222.0.86 () {56 vars in 1180 bytes} [Fri Jul 15 16:25:10 2022] GET /identity/v3/groups/928ef35120844f7a967c38f405c8391b => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:11.164947 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614763a3-acc3-4d3c-97c8-6f5f6fc1aca4 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:11.221081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab750e-8724-45ae-b37a-148447d77fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:11.222013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab750e-8724-45ae-b37a-148447d77fec None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:11.222437 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab750e-8724-45ae-b37a-148447d77fec None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:11.222902 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab750e-8724-45ae-b37a-148447d77fec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:11.274761 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614763a3-acc3-4d3c-97c8-6f5f6fc1aca4 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:11.316388 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c74dbf-a2ed-414e-b33d-dbf696716af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:11.317161 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c74dbf-a2ed-414e-b33d-dbf696716af9 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:11.317450 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c74dbf-a2ed-414e-b33d-dbf696716af9 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:11.317724 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c74dbf-a2ed-414e-b33d-dbf696716af9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:11.318561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c74dbf-a2ed-414e-b33d-dbf696716af9 None admin] RBAC: Adding query filter params (group.id=928ef35120844f7a967c38f405c8391b, role.id=3bed7bde1b98412b94a181719432cfa1, scope.project.id=f26148acb7004ff78333b7b62586ed2e) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:11.318893 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c74dbf-a2ed-414e-b33d-dbf696716af9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:11.320613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c74dbf-a2ed-414e-b33d-dbf696716af9 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:11.328314 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 208/427] 10.222.0.86 () {56 vars in 1376 bytes} [Fri Jul 15 16:25:11 2022] GET /identity/v3/role_assignments?group.id=928ef35120844f7a967c38f405c8391b&scope.project.id=f26148acb7004ff78333b7b62586ed2e&role.id=3bed7bde1b98412b94a181719432cfa1 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:11.329645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afff7c7-4003-4977-b7df-fa73dcf59732 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:11.329932 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afff7c7-4003-4977-b7df-fa73dcf59732 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:11.330209 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afff7c7-4003-4977-b7df-fa73dcf59732 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:11.334351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab750e-8724-45ae-b37a-148447d77fec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:11.336089 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 209/428] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:11.336205 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab750e-8724-45ae-b37a-148447d77fec None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:11.337537 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8fc39-fbda-4a79-bed8-d654703d0236 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:11.337830 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8fc39-fbda-4a79-bed8-d654703d0236 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:11.338229 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8fc39-fbda-4a79-bed8-d654703d0236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:11.356591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-99a8fc39-fbda-4a79-bed8-d654703d0236 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:11.357831 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-99a8fc39-fbda-4a79-bed8-d654703d0236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:11.362399 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:11.407350 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:11.448667 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 220/429] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:11.450062 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab750e-8724-45ae-b37a-148447d77fec None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:11.500932 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 210/430] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:25:11.539446 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8fc39-fbda-4a79-bed8-d654703d0236 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:11.576886 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab750e-8724-45ae-b37a-148447d77fec None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:11.607685 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:11.623393 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c5fd2-4bb1-4f78-91f2-61e6bc8f6e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:11.624502 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c5fd2-4bb1-4f78-91f2-61e6bc8f6e5b None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:11.624936 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c5fd2-4bb1-4f78-91f2-61e6bc8f6e5b None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:11.625358 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c5fd2-4bb1-4f78-91f2-61e6bc8f6e5b None admin] PATH_INFO: `/v3/projects/f26148acb7004ff78333b7b62586ed2e` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:11.627337 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c5fd2-4bb1-4f78-91f2-61e6bc8f6e5b None admin] RBAC: Authorizing `identity:get_project(project_id=f26148acb7004ff78333b7b62586ed2e)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:11.629500 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c5fd2-4bb1-4f78-91f2-61e6bc8f6e5b None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:11.632637 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 221/431] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:25:11 2022] GET /identity/v3/projects/f26148acb7004ff78333b7b62586ed2e => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:11.639414 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c5fd2-4bb1-4f78-91f2-61e6bc8f6e5b None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:11.697675 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8fc39-fbda-4a79-bed8-d654703d0236 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:11.753998 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb48e1-1405-45a6-9d46-96836861b49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:11.754832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb48e1-1405-45a6-9d46-96836861b49f None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:11.755154 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb48e1-1405-45a6-9d46-96836861b49f None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:11.755434 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb48e1-1405-45a6-9d46-96836861b49f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:11.773152 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb48e1-1405-45a6-9d46-96836861b49f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:11.780470 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c5fd2-4bb1-4f78-91f2-61e6bc8f6e5b None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-2ceb48e1-1405-45a6-9d46-96836861b49f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:11.784722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:11.785943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:11.786765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:11.786765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:11.786765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:11.786765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:11.786765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:11.786765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:11.786765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:11.786765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:11.786765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:11.786765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:11.786765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 16:25:11.786765 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:11.787413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 211/432] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:11.798102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb48e1-1405-45a6-9d46-96836861b49f None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:11.827254 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd08fb-1dd1-4d3a-8247-fd5c15bee7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:11.828129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd08fb-1dd1-4d3a-8247-fd5c15bee7fe None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:11.828417 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd08fb-1dd1-4d3a-8247-fd5c15bee7fe None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:11.828699 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd08fb-1dd1-4d3a-8247-fd5c15bee7fe None admin] PATH_INFO: `/v3/groups/928ef35120844f7a967c38f405c8391b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:11.830179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:11.831326 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd08fb-1dd1-4d3a-8247-fd5c15bee7fe None admin] RBAC: Authorizing `identity:get_group(group_id=928ef35120844f7a967c38f405c8391b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:11.833105 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd08fb-1dd1-4d3a-8247-fd5c15bee7fe None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:11.838957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 222/433] 10.222.0.86 () {56 vars in 1180 bytes} [Fri Jul 15 16:25:11 2022] GET /identity/v3/groups/928ef35120844f7a967c38f405c8391b => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:11.842135 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd08fb-1dd1-4d3a-8247-fd5c15bee7fe None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:11.915289 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:11.928532 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb48e1-1405-45a6-9d46-96836861b49f None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:11.961988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd08fb-1dd1-4d3a-8247-fd5c15bee7fe None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:11.969382 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881d620-525d-4a3a-a146-1ca6951fe444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:11.970198 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881d620-525d-4a3a-a146-1ca6951fe444 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:11.970554 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881d620-525d-4a3a-a146-1ca6951fe444 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:11.970962 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881d620-525d-4a3a-a146-1ca6951fe444 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:11.971790 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881d620-525d-4a3a-a146-1ca6951fe444 None admin] RBAC: Adding query filter params (name=member) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:11.972169 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881d620-525d-4a3a-a146-1ca6951fe444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:11.973638 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881d620-525d-4a3a-a146-1ca6951fe444 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:11.983949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 212/434] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:25:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:11.988899 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881d620-525d-4a3a-a146-1ca6951fe444 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:12.001951 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d3e83-4c03-4fea-aebe-19a80ba16db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:12.002830 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d3e83-4c03-4fea-aebe-19a80ba16db1 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:12.003306 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d3e83-4c03-4fea-aebe-19a80ba16db1 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:12.003885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d3e83-4c03-4fea-aebe-19a80ba16db1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:12.004918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d3e83-4c03-4fea-aebe-19a80ba16db1 None admin] RBAC: Adding query filter params (group.id=928ef35120844f7a967c38f405c8391b, role.id=5b22d10db4e647389fd8b36e1bc524fd, scope.project.id=f26148acb7004ff78333b7b62586ed2e) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:12.005458 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d3e83-4c03-4fea-aebe-19a80ba16db1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:12.007105 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d3e83-4c03-4fea-aebe-19a80ba16db1 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:12.019056 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 223/435] 10.222.0.86 () {56 vars in 1376 bytes} [Fri Jul 15 16:25:11 2022] GET /identity/v3/role_assignments?group.id=928ef35120844f7a967c38f405c8391b&scope.project.id=f26148acb7004ff78333b7b62586ed2e&role.id=5b22d10db4e647389fd8b36e1bc524fd => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:12.088814 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:12.110508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881d620-525d-4a3a-a146-1ca6951fe444 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:12.148327 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23248790-6398-41d0-a6ed-9b3fa166eebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:12.148994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23248790-6398-41d0-a6ed-9b3fa166eebc None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:12.149280 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23248790-6398-41d0-a6ed-9b3fa166eebc None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:12.149556 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23248790-6398-41d0-a6ed-9b3fa166eebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:12.230763 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23248790-6398-41d0-a6ed-9b3fa166eebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:12.232352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23248790-6398-41d0-a6ed-9b3fa166eebc None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:12.331748 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:12.352182 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 213/436] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 16:25:12.357410 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d3e83-4c03-4fea-aebe-19a80ba16db1 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:12.382637 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45043046-d1bd-4313-b72e-f51a55928db6 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:12.382960 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45043046-d1bd-4313-b72e-f51a55928db6 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:12.383242 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45043046-d1bd-4313-b72e-f51a55928db6 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:12.384741 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 214/437] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:12.390360 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013b100-4465-42ff-8256-2ff0001717a1 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:12.390644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013b100-4465-42ff-8256-2ff0001717a1 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:12.390991 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013b100-4465-42ff-8256-2ff0001717a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:12.409611 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-7013b100-4465-42ff-8256-2ff0001717a1 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:12.410809 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-7013b100-4465-42ff-8256-2ff0001717a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:12.483985 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d3e83-4c03-4fea-aebe-19a80ba16db1 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:12.502763 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 215/438] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:25:12.519225 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:12.528442 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013b100-4465-42ff-8256-2ff0001717a1 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:12.536088 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbd208-281c-41e6-a573-2b8100125a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:12.536990 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbd208-281c-41e6-a573-2b8100125a79 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:12.537263 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbd208-281c-41e6-a573-2b8100125a79 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:12.537543 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbd208-281c-41e6-a573-2b8100125a79 None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:12.539357 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbd208-281c-41e6-a573-2b8100125a79 None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:12.541207 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbd208-281c-41e6-a573-2b8100125a79 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:12.543631 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 224/439] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:25:12 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:12.549670 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbd208-281c-41e6-a573-2b8100125a79 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:12.654239 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013b100-4465-42ff-8256-2ff0001717a1 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:12.680566 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:12.696290 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbd208-281c-41e6-a573-2b8100125a79 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:12.706021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae0db2-16e6-4786-84f1-a5bcd8569e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:12.706839 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae0db2-16e6-4786-84f1-a5bcd8569e54 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:12.707159 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae0db2-16e6-4786-84f1-a5bcd8569e54 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:12.707440 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae0db2-16e6-4786-84f1-a5bcd8569e54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:12.718208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae0db2-16e6-4786-84f1-a5bcd8569e54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-49ae0db2-16e6-4786-84f1-a5bcd8569e54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:12.726526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:12.727555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:12.728389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:12.728389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:12.728389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:12.728389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:12.728389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:12.728389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:12.728389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:12.728389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:12.728389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:12.728389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:12.728389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 16:25:12.728389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:12.728389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 216/440] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:25:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:12.734348 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae0db2-16e6-4786-84f1-a5bcd8569e54 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:12.737908 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d412971-b9d4-4397-9df6-74ee13afa977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:12.739011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d412971-b9d4-4397-9df6-74ee13afa977 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:12.739465 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d412971-b9d4-4397-9df6-74ee13afa977 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:12.739802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d412971-b9d4-4397-9df6-74ee13afa977 None admin] PATH_INFO: `/v3/groups/928ef35120844f7a967c38f405c8391b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:12.741008 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d412971-b9d4-4397-9df6-74ee13afa977 None admin] RBAC: Authorizing `identity:get_group(group_id=928ef35120844f7a967c38f405c8391b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:12.742446 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d412971-b9d4-4397-9df6-74ee13afa977 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:12.744103 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 225/441] 10.222.0.86 () {56 vars in 1180 bytes} [Fri Jul 15 16:25:12 2022] GET /identity/v3/groups/928ef35120844f7a967c38f405c8391b => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:12.750394 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d412971-b9d4-4397-9df6-74ee13afa977 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:12.815913 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:12.856038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae0db2-16e6-4786-84f1-a5bcd8569e54 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:12.869237 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d412971-b9d4-4397-9df6-74ee13afa977 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:12.893391 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25e6e4-0e24-4f8e-8edc-b070cbd2d6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:12.894059 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25e6e4-0e24-4f8e-8edc-b070cbd2d6cd None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:12.894351 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25e6e4-0e24-4f8e-8edc-b070cbd2d6cd None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:12.894628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25e6e4-0e24-4f8e-8edc-b070cbd2d6cd None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:12.895419 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25e6e4-0e24-4f8e-8edc-b070cbd2d6cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:12.895728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25e6e4-0e24-4f8e-8edc-b070cbd2d6cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:12.897090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25e6e4-0e24-4f8e-8edc-b070cbd2d6cd None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:12.905382 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 217/442] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:12.908979 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3ad07-6822-4b69-878a-5461d3ad0d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:12.909917 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3ad07-6822-4b69-878a-5461d3ad0d0a None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:12.910347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3ad07-6822-4b69-878a-5461d3ad0d0a None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:12.910778 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3ad07-6822-4b69-878a-5461d3ad0d0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:12.910921 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25e6e4-0e24-4f8e-8edc-b070cbd2d6cd None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:12.912117 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3ad07-6822-4b69-878a-5461d3ad0d0a None admin] RBAC: Adding query filter params (group.id=928ef35120844f7a967c38f405c8391b, role.id=3bed7bde1b98412b94a181719432cfa1, scope.project.id=78bf28db88014ad38e46d572425a9c71) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:12.912578 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3ad07-6822-4b69-878a-5461d3ad0d0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:12.914142 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3ad07-6822-4b69-878a-5461d3ad0d0a None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:12.920935 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 226/443] 10.222.0.86 () {56 vars in 1376 bytes} [Fri Jul 15 16:25:12 2022] GET /identity/v3/role_assignments?group.id=928ef35120844f7a967c38f405c8391b&scope.project.id=78bf28db88014ad38e46d572425a9c71&role.id=3bed7bde1b98412b94a181719432cfa1 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:12.959364 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:12.967917 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7613a-8f82-4cb7-bae2-9469f7fa3b3c None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:12.968207 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7613a-8f82-4cb7-bae2-9469f7fa3b3c None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:12.968492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7613a-8f82-4cb7-bae2-9469f7fa3b3c None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:12.970409 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 227/444] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:25:12.976368 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724b6c4-0da1-4ecf-8d2a-bd53babd5982 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:12.976660 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724b6c4-0da1-4ecf-8d2a-bd53babd5982 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:12.976934 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724b6c4-0da1-4ecf-8d2a-bd53babd5982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:12.994401 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-7724b6c4-0da1-4ecf-8d2a-bd53babd5982 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:12.995733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-7724b6c4-0da1-4ecf-8d2a-bd53babd5982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:13.037746 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25e6e4-0e24-4f8e-8edc-b070cbd2d6cd None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:13.070328 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 228/445] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:25:13.077212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b3d03-5e56-43f3-a525-fe598fe62fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:13.077967 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b3d03-5e56-43f3-a525-fe598fe62fca None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:13.078321 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b3d03-5e56-43f3-a525-fe598fe62fca None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:13.078690 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b3d03-5e56-43f3-a525-fe598fe62fca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:13.095284 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724b6c4-0da1-4ecf-8d2a-bd53babd5982 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:13.160078 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b3d03-5e56-43f3-a525-fe598fe62fca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:13.161469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b3d03-5e56-43f3-a525-fe598fe62fca None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:13.169632 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:13.199822 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:13.227726 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724b6c4-0da1-4ecf-8d2a-bd53babd5982 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:13.272200 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7bf86-8226-4933-be92-396a809aaef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:13.273143 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7bf86-8226-4933-be92-396a809aaef3 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:13.273432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7bf86-8226-4933-be92-396a809aaef3 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:13.273704 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7bf86-8226-4933-be92-396a809aaef3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:13.286540 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 218/446] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:13.287742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7bf86-8226-4933-be92-396a809aaef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:13.292815 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b3d03-5e56-43f3-a525-fe598fe62fca None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-21d7bf86-8226-4933-be92-396a809aaef3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:13.296013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:13.297095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:13.298114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:13.298114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:13.298114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:13.298114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:13.298114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:13.298114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:13.298114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:13.298114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:13.298114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:13.298114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:13.298114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:25:13.298114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:13.298114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 229/447] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:25:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:13.303175 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7bf86-8226-4933-be92-396a809aaef3 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:13.398983 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b3d03-5e56-43f3-a525-fe598fe62fca None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:13.403748 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7bf86-8226-4933-be92-396a809aaef3 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:13.417458 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:13.432811 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6b5bb-cbd2-49c1-ad1a-471d03767da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:13.433665 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6b5bb-cbd2-49c1-ad1a-471d03767da6 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:13.433952 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6b5bb-cbd2-49c1-ad1a-471d03767da6 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:13.434229 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6b5bb-cbd2-49c1-ad1a-471d03767da6 None admin] PATH_INFO: `/v3/projects/78bf28db88014ad38e46d572425a9c71` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:13.435968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6b5bb-cbd2-49c1-ad1a-471d03767da6 None admin] RBAC: Authorizing `identity:get_project(project_id=78bf28db88014ad38e46d572425a9c71)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:13.437391 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6b5bb-cbd2-49c1-ad1a-471d03767da6 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:13.439080 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 219/448] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:25:13 2022] GET /identity/v3/projects/78bf28db88014ad38e46d572425a9c71 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:13.439198 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca762f4-eb5c-45ce-87a7-9739f1751417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:13.439885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca762f4-eb5c-45ce-87a7-9739f1751417 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:13.440247 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca762f4-eb5c-45ce-87a7-9739f1751417 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:13.440532 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca762f4-eb5c-45ce-87a7-9739f1751417 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:13.441279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca762f4-eb5c-45ce-87a7-9739f1751417 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:13.441590 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca762f4-eb5c-45ce-87a7-9739f1751417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:13.442959 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca762f4-eb5c-45ce-87a7-9739f1751417 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:13.444393 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6b5bb-cbd2-49c1-ad1a-471d03767da6 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:13.447270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:13.452001 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 230/449] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:13.457291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca762f4-eb5c-45ce-87a7-9739f1751417 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:13.545345 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6b5bb-cbd2-49c1-ad1a-471d03767da6 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:13.554819 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca762f4-eb5c-45ce-87a7-9739f1751417 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:13.579100 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499bdac-11aa-46a2-a7b3-5428872cc3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:13.579959 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499bdac-11aa-46a2-a7b3-5428872cc3d5 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:13.580250 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499bdac-11aa-46a2-a7b3-5428872cc3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:13.580529 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499bdac-11aa-46a2-a7b3-5428872cc3d5 None admin] PATH_INFO: `/v3/groups/928ef35120844f7a967c38f405c8391b` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:13.581777 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499bdac-11aa-46a2-a7b3-5428872cc3d5 None admin] RBAC: Authorizing `identity:get_group(group_id=928ef35120844f7a967c38f405c8391b)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:13.583260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499bdac-11aa-46a2-a7b3-5428872cc3d5 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:13.589543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 220/450] 10.222.0.86 () {56 vars in 1180 bytes} [Fri Jul 15 16:25:13 2022] GET /identity/v3/groups/928ef35120844f7a967c38f405c8391b => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:13.589691 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aca7d9-9654-4914-be88-ba9e81bb0f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:13.589691 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aca7d9-9654-4914-be88-ba9e81bb0f3c None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:13.589691 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aca7d9-9654-4914-be88-ba9e81bb0f3c None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:13.589934 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aca7d9-9654-4914-be88-ba9e81bb0f3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:13.590483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499bdac-11aa-46a2-a7b3-5428872cc3d5 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:13.635595 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:13.658486 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:13.660899 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aca7d9-9654-4914-be88-ba9e81bb0f3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:13.662355 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aca7d9-9654-4914-be88-ba9e81bb0f3c None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:13.688510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499bdac-11aa-46a2-a7b3-5428872cc3d5 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:13.723529 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d298d-0559-479b-8c19-db9dbfed3a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:13.724187 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d298d-0559-479b-8c19-db9dbfed3a7c None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:13.724477 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d298d-0559-479b-8c19-db9dbfed3a7c None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:13.724755 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d298d-0559-479b-8c19-db9dbfed3a7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:13.725580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d298d-0559-479b-8c19-db9dbfed3a7c None admin] RBAC: Adding query filter params (group.id=928ef35120844f7a967c38f405c8391b, role.id=5b22d10db4e647389fd8b36e1bc524fd, scope.project.id=78bf28db88014ad38e46d572425a9c71) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:13.725897 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d298d-0559-479b-8c19-db9dbfed3a7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:13.727440 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d298d-0559-479b-8c19-db9dbfed3a7c None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:13.733918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 221/451] 10.222.0.86 () {56 vars in 1376 bytes} [Fri Jul 15 16:25:13 2022] GET /identity/v3/role_assignments?group.id=928ef35120844f7a967c38f405c8391b&scope.project.id=78bf28db88014ad38e46d572425a9c71&role.id=5b22d10db4e647389fd8b36e1bc524fd => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:13.762157 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 231/452] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 16:25:13.768001 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d298d-0559-479b-8c19-db9dbfed3a7c None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:13.876935 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d298d-0559-479b-8c19-db9dbfed3a7c None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:13.912300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2faf860-60cb-4d1d-bdd4-1f4006dfc587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:13.913161 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2faf860-60cb-4d1d-bdd4-1f4006dfc587 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:13.913450 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2faf860-60cb-4d1d-bdd4-1f4006dfc587 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:13.913723 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2faf860-60cb-4d1d-bdd4-1f4006dfc587 None admin] PATH_INFO: `/v3/projects/fcb5a6ba5f5c46348953f622f9e98380` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:13.915749 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2faf860-60cb-4d1d-bdd4-1f4006dfc587 None admin] RBAC: Authorizing `identity:get_project(project_id=fcb5a6ba5f5c46348953f622f9e98380)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:13.917170 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2faf860-60cb-4d1d-bdd4-1f4006dfc587 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:13.918845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 222/453] 10.222.0.86 () {56 vars in 1186 bytes} [Fri Jul 15 16:25:13 2022] GET /identity/v3/projects/fcb5a6ba5f5c46348953f622f9e98380 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:13.925156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aca7d9-9654-4914-be88-ba9e81bb0f3c None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:14.003370 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:14.026574 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aca7d9-9654-4914-be88-ba9e81bb0f3c None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:14.060129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3fe1d-31b0-40a6-872a-ffd946c512fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:14.060982 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3fe1d-31b0-40a6-872a-ffd946c512fa None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:14.061266 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3fe1d-31b0-40a6-872a-ffd946c512fa None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:14.061543 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3fe1d-31b0-40a6-872a-ffd946c512fa None admin] PATH_INFO: `/v3/groups/abbb3df324044907ba1400444a6a4520` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:14.062816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3fe1d-31b0-40a6-872a-ffd946c512fa None admin] RBAC: Authorizing `identity:get_group(group_id=abbb3df324044907ba1400444a6a4520)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:14.064285 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3fe1d-31b0-40a6-872a-ffd946c512fa None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:14.065905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 232/454] 10.222.0.86 () {56 vars in 1180 bytes} [Fri Jul 15 16:25:13 2022] GET /identity/v3/groups/abbb3df324044907ba1400444a6a4520 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:14.071786 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2faf860-60cb-4d1d-bdd4-1f4006dfc587 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:14.074675 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:14.172338 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2faf860-60cb-4d1d-bdd4-1f4006dfc587 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:14.205086 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c391db-7b14-4894-bba6-f987fc38fc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:14.205737 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c391db-7b14-4894-bba6-f987fc38fc63 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:14.206023 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c391db-7b14-4894-bba6-f987fc38fc63 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:14.206305 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c391db-7b14-4894-bba6-f987fc38fc63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:14.207159 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c391db-7b14-4894-bba6-f987fc38fc63 None admin] RBAC: Adding query filter params (group.id=abbb3df324044907ba1400444a6a4520, role.id=923dd61feaca45d0933a4601fb2c065b, scope.project.id=fcb5a6ba5f5c46348953f622f9e98380) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:14.207476 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c391db-7b14-4894-bba6-f987fc38fc63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:14.208915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c391db-7b14-4894-bba6-f987fc38fc63 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:14.214546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 223/455] 10.222.0.86 () {56 vars in 1376 bytes} [Fri Jul 15 16:25:14 2022] GET /identity/v3/role_assignments?group.id=abbb3df324044907ba1400444a6a4520&scope.project.id=fcb5a6ba5f5c46348953f622f9e98380&role.id=923dd61feaca45d0933a4601fb2c065b => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:16.716657 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d34d02-d132-4bb3-86e1-791209f6bcb2 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:16.717238 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d34d02-d132-4bb3-86e1-791209f6bcb2 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:16.717238 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d34d02-d132-4bb3-86e1-791209f6bcb2 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:16.719068 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 233/456] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:16.725156 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70ea8f-fc03-4a80-8ad9-5b18b02a0652 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:16.725700 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70ea8f-fc03-4a80-8ad9-5b18b02a0652 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:16.725700 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70ea8f-fc03-4a80-8ad9-5b18b02a0652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:16.744020 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-ad70ea8f-fc03-4a80-8ad9-5b18b02a0652 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:16.745251 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-ad70ea8f-fc03-4a80-8ad9-5b18b02a0652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:16.815829 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:16.824350 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 224/457] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:16.851664 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d34d02-d132-4bb3-86e1-791209f6bcb2 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:16.892199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e7af9-1ed5-425b-bb17-878c9c5e8bc0 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:16.892501 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e7af9-1ed5-425b-bb17-878c9c5e8bc0 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:16.892767 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e7af9-1ed5-425b-bb17-878c9c5e8bc0 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:16.894563 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 225/458] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:16.899534 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fa098-d975-4159-84b8-032b9c9add25 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:16.899819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fa098-d975-4159-84b8-032b9c9add25 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:16.900098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fa098-d975-4159-84b8-032b9c9add25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:16.919279 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-179fa098-d975-4159-84b8-032b9c9add25 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:16.920662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-179fa098-d975-4159-84b8-032b9c9add25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:16.968143 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d34d02-d132-4bb3-86e1-791209f6bcb2 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:17.006754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f41c6-c69d-41c0-a1fd-4d5cc499962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:17.007585 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f41c6-c69d-41c0-a1fd-4d5cc499962b None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:17.007934 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f41c6-c69d-41c0-a1fd-4d5cc499962b None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:17.008215 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f41c6-c69d-41c0-a1fd-4d5cc499962b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:17.011036 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 226/459] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:25:17.012418 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a205b6e-df3e-41f9-81a0-bd50111b1051 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:17.012714 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a205b6e-df3e-41f9-81a0-bd50111b1051 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:17.012996 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a205b6e-df3e-41f9-81a0-bd50111b1051 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:17.015070 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 227/460] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:17.020134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301b5a5-705d-4718-b8f0-a1ab56612ed8 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:17.020437 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301b5a5-705d-4718-b8f0-a1ab56612ed8 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:17.020714 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301b5a5-705d-4718-b8f0-a1ab56612ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:17.021534 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f41c6-c69d-41c0-a1fd-4d5cc499962b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:17.023344 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f41c6-c69d-41c0-a1fd-4d5cc499962b None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:17.026145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:17.039991 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-5301b5a5-705d-4718-b8f0-a1ab56612ed8 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:17.041175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-5301b5a5-705d-4718-b8f0-a1ab56612ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:17.042818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-7e6f41c6-c69d-41c0-a1fd-4d5cc499962b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:17.042818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:17.042818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:17.042818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:17.042818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:17.042818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:17.042818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:17.042818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:17.042818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:17.042818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:17.042818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:17.042818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:17.042818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:17.042818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:17.042818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:17.043838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:17.045295 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:17.045295 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:17.045295 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:17.045295 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:17.051518 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 234/461] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:17.051518 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f41c6-c69d-41c0-a1fd-4d5cc499962b None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:17.114667 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 228/462] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:17.115347 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301b5a5-705d-4718-b8f0-a1ab56612ed8 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:17.167329 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f41c6-c69d-41c0-a1fd-4d5cc499962b None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:17.176294 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:17.206752 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5d7fd-b258-46de-8f4b-b56c6014f685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:17.207713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5d7fd-b258-46de-8f4b-b56c6014f685 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:17.207996 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5d7fd-b258-46de-8f4b-b56c6014f685 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:17.208341 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5d7fd-b258-46de-8f4b-b56c6014f685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:17.221938 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5d7fd-b258-46de-8f4b-b56c6014f685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:17.223950 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5d7fd-b258-46de-8f4b-b56c6014f685 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:17.227485 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301b5a5-705d-4718-b8f0-a1ab56612ed8 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:17.248914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-91a5d7fd-b258-46de-8f4b-b56c6014f685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:17.248914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:17.248914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:17.248914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:17.248914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:17.248914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:17.248914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:17.248914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:17.248914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:17.248914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:17.248914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:17.248914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:17.248914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:17.248914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:17.248914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:17.250004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:17.251048 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:17.251048 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:17.251048 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:17.251048 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:17.251048 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 235/463] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:17.251369 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5d7fd-b258-46de-8f4b-b56c6014f685 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:17.275832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01d1ad-5ff5-4830-80cf-faf2bf0a62c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:17.276607 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01d1ad-5ff5-4830-80cf-faf2bf0a62c2 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:17.276963 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01d1ad-5ff5-4830-80cf-faf2bf0a62c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:17.277243 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01d1ad-5ff5-4830-80cf-faf2bf0a62c2 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:17.277965 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01d1ad-5ff5-4830-80cf-faf2bf0a62c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:17.278276 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01d1ad-5ff5-4830-80cf-faf2bf0a62c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:17.279716 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01d1ad-5ff5-4830-80cf-faf2bf0a62c2 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:17.296199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 229/464] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:17.296199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01d1ad-5ff5-4830-80cf-faf2bf0a62c2 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:17.307300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:17.364154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5d7fd-b258-46de-8f4b-b56c6014f685 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:17.398849 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01d1ad-5ff5-4830-80cf-faf2bf0a62c2 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:17.400278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9d8a5-df38-4bbb-8b41-d32da12a0bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:17.401053 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9d8a5-df38-4bbb-8b41-d32da12a0bbe None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:17.401333 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9d8a5-df38-4bbb-8b41-d32da12a0bbe None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:17.401611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9d8a5-df38-4bbb-8b41-d32da12a0bbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:17.412708 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9d8a5-df38-4bbb-8b41-d32da12a0bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:17.414147 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9d8a5-df38-4bbb-8b41-d32da12a0bbe None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:17.414932 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:17.432309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-f9d9d8a5-df38-4bbb-8b41-d32da12a0bbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:17.432309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:17.432309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:17.432309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:17.432309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:17.432309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:17.432309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:17.432309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:17.432309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:17.432309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:17.432309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:17.432309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:17.432309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:17.432309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:17.432309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:17.433241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:17.434067 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:17.434067 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:17.434067 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:17.434067 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:17.434285 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244fa1c-c563-4b35-bf5a-91261ef3e109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:17.434388 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 236/465] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:17.434457 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244fa1c-c563-4b35-bf5a-91261ef3e109 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:17.434521 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9d8a5-df38-4bbb-8b41-d32da12a0bbe None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:17.434585 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244fa1c-c563-4b35-bf5a-91261ef3e109 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:17.434585 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244fa1c-c563-4b35-bf5a-91261ef3e109 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:17.435373 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244fa1c-c563-4b35-bf5a-91261ef3e109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:17.435688 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244fa1c-c563-4b35-bf5a-91261ef3e109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:17.437057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244fa1c-c563-4b35-bf5a-91261ef3e109 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:17.448882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 230/466] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:17.450135 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c3e4e-45b1-4899-8127-0074c38b4a43 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:17.450425 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c3e4e-45b1-4899-8127-0074c38b4a43 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:17.451068 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c3e4e-45b1-4899-8127-0074c38b4a43 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:17.452383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 231/467] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:17.453010 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c3e4e-45b1-4899-8127-0074c38b4a43 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:17.537501 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:17.540514 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9d8a5-df38-4bbb-8b41-d32da12a0bbe None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:17.556234 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c3e4e-45b1-4899-8127-0074c38b4a43 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:17.574426 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aebd18-d182-4920-998b-4c441a4876bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:17.575111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aebd18-d182-4920-998b-4c441a4876bd None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:17.575401 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aebd18-d182-4920-998b-4c441a4876bd None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:17.575955 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aebd18-d182-4920-998b-4c441a4876bd None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:17.576647 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aebd18-d182-4920-998b-4c441a4876bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:17.578067 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aebd18-d182-4920-998b-4c441a4876bd None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:17.589155 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d73dc-5aae-4576-a6e2-6aaef1b69a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:17.589953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d73dc-5aae-4576-a6e2-6aaef1b69a7e None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:17.590276 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d73dc-5aae-4576-a6e2-6aaef1b69a7e None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:17.590577 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d73dc-5aae-4576-a6e2-6aaef1b69a7e None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:17.591970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d73dc-5aae-4576-a6e2-6aaef1b69a7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:17.592282 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d73dc-5aae-4576-a6e2-6aaef1b69a7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:17.593801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d73dc-5aae-4576-a6e2-6aaef1b69a7e None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:17.598028 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 237/468] 10.222.0.86 () {60 vars in 1132 bytes} [Fri Jul 15 16:25:17 2022] POST /identity/v3/users => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:25:17.598805 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aebd18-d182-4920-998b-4c441a4876bd None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:17.610685 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 232/469] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:17.610685 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ac2fd-b95f-48a8-97d4-47fd4de095c1 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:17.610685 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ac2fd-b95f-48a8-97d4-47fd4de095c1 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:17.610685 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ac2fd-b95f-48a8-97d4-47fd4de095c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:17.625138 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-f25ac2fd-b95f-48a8-97d4-47fd4de095c1 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:17.626369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-f25ac2fd-b95f-48a8-97d4-47fd4de095c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:17.657619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:17.706250 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 233/470] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:17.707652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ac2fd-b95f-48a8-97d4-47fd4de095c1 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:17.728878 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aebd18-d182-4920-998b-4c441a4876bd None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:17.769439 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84514c0b-ec71-4c89-b2c2-fc14be706249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:17.770117 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84514c0b-ec71-4c89-b2c2-fc14be706249 None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:17.770404 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84514c0b-ec71-4c89-b2c2-fc14be706249 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:17.770683 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84514c0b-ec71-4c89-b2c2-fc14be706249 None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:17.771517 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84514c0b-ec71-4c89-b2c2-fc14be706249 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:17.773027 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84514c0b-ec71-4c89-b2c2-fc14be706249 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:17.794636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 238/471] 10.222.0.86 () {60 vars in 1132 bytes} [Fri Jul 15 16:25:17 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:25:17.795529 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84514c0b-ec71-4c89-b2c2-fc14be706249 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:17.817342 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:17.832020 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ac2fd-b95f-48a8-97d4-47fd4de095c1 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:17.881319 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce7c46-cbae-4e82-9351-f269678087fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:17.882009 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce7c46-cbae-4e82-9351-f269678087fc None admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:17.882376 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce7c46-cbae-4e82-9351-f269678087fc None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:17.882812 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce7c46-cbae-4e82-9351-f269678087fc None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:17.883819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce7c46-cbae-4e82-9351-f269678087fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:17.885213 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce7c46-cbae-4e82-9351-f269678087fc None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:17.913719 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 234/472] 10.222.0.86 () {60 vars in 1132 bytes} [Fri Jul 15 16:25:17 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:25:17.960013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84514c0b-ec71-4c89-b2c2-fc14be706249 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:18.004976 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d1574-203f-402f-959c-52a3242f31b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:18.006099 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d1574-203f-402f-959c-52a3242f31b2 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:18.006577 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d1574-203f-402f-959c-52a3242f31b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:18.006854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d1574-203f-402f-959c-52a3242f31b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:18.019844 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d1574-203f-402f-959c-52a3242f31b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:18.021306 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d1574-203f-402f-959c-52a3242f31b2 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:18.040816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-d89d1574-203f-402f-959c-52a3242f31b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:18.040816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:18.040816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:18.040816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:18.040816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:18.040816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:18.040816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:18.040816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:18.040816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:18.040816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:18.040816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:18.040816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:18.040816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:18.040816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:18.040816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:18.041760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:18.042627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:18.042627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:18.042627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:18.042627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:18.042627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 239/473] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:18.049607 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce7c46-cbae-4e82-9351-f269678087fc None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:18.082651 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:18.166655 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce7c46-cbae-4e82-9351-f269678087fc None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:18.205895 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bc770-c365-4355-a8bc-d1c66b028a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:18.207036 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bc770-c365-4355-a8bc-d1c66b028a56 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:18.207320 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bc770-c365-4355-a8bc-d1c66b028a56 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:18.207600 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bc770-c365-4355-a8bc-d1c66b028a56 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:18.208330 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bc770-c365-4355-a8bc-d1c66b028a56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:18.208639 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bc770-c365-4355-a8bc-d1c66b028a56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:18.210049 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bc770-c365-4355-a8bc-d1c66b028a56 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:18.224218 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 235/474] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:18.229640 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d1574-203f-402f-959c-52a3242f31b2 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:18.306165 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:18.349857 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d1574-203f-402f-959c-52a3242f31b2 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:18.385988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8c858-4bf0-4fef-8239-0840c896fc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:18.386987 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8c858-4bf0-4fef-8239-0840c896fc2f None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:18.387447 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8c858-4bf0-4fef-8239-0840c896fc2f None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:18.387922 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8c858-4bf0-4fef-8239-0840c896fc2f None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:18.389339 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8c858-4bf0-4fef-8239-0840c896fc2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:18.390974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8c858-4bf0-4fef-8239-0840c896fc2f None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:18.413365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 240/475] 10.222.0.86 () {60 vars in 1132 bytes} [Fri Jul 15 16:25:18 2022] POST /identity/v3/users => generated 249 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 16:25:20.055140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e76084-10b9-4382-84af-a2ff29c3a7d6 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:20.056202 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e76084-10b9-4382-84af-a2ff29c3a7d6 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:20.056697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e76084-10b9-4382-84af-a2ff29c3a7d6 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:20.058748 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 236/476] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:20.065083 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049ae43-a4ad-4438-a95e-3369cecc26e3 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:20.066070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049ae43-a4ad-4438-a95e-3369cecc26e3 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:20.066558 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049ae43-a4ad-4438-a95e-3369cecc26e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:20.085802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-f049ae43-a4ad-4438-a95e-3369cecc26e3 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:20.087530 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-f049ae43-a4ad-4438-a95e-3369cecc26e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:20.166063 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 241/477] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:20.191672 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e76084-10b9-4382-84af-a2ff29c3a7d6 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:20.212997 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960fe61-3bdb-442d-82ea-5f3966faace8 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:20.213298 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960fe61-3bdb-442d-82ea-5f3966faace8 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:20.213564 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960fe61-3bdb-442d-82ea-5f3966faace8 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:20.215246 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 242/478] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:25:20.224065 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc44bc9-fbdb-4286-ba13-139473de0cef None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:20.224481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc44bc9-fbdb-4286-ba13-139473de0cef None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:20.225082 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc44bc9-fbdb-4286-ba13-139473de0cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:20.243783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-8dc44bc9-fbdb-4286-ba13-139473de0cef None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:20.244909 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-8dc44bc9-fbdb-4286-ba13-139473de0cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:20.286010 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:20.306478 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:20.309711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e76084-10b9-4382-84af-a2ff29c3a7d6 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:20.332157 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 243/479] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:25:20.333548 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283d87d-835e-4803-9d5e-7b3a06025e5c None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:20.333841 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283d87d-835e-4803-9d5e-7b3a06025e5c None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:20.334115 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283d87d-835e-4803-9d5e-7b3a06025e5c None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:20.335668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 244/480] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:20.344557 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5529f4-b738-41f2-b9ab-867117db4e89 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:20.344971 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5529f4-b738-41f2-b9ab-867117db4e89 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:20.345255 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5529f4-b738-41f2-b9ab-867117db4e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:20.354393 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b72441-252e-44e0-831d-22fe8432082a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:20.355431 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b72441-252e-44e0-831d-22fe8432082a None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:20.355861 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b72441-252e-44e0-831d-22fe8432082a None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:20.356283 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b72441-252e-44e0-831d-22fe8432082a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:20.364826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-6e5529f4-b738-41f2-b9ab-867117db4e89 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:20.366012 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-6e5529f4-b738-41f2-b9ab-867117db4e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:20.369625 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b72441-252e-44e0-831d-22fe8432082a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-28b72441-252e-44e0-831d-22fe8432082a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:20.379463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:20.380343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:20.381113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:20.381113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:20.381113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:20.381113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:20.381113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:20.381113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:20.381113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:20.381113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:20.381113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:20.381113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:20.381113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:20.381113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:20.381730 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 237/481] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:25:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:20.382792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b72441-252e-44e0-831d-22fe8432082a None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:20.442852 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 245/482] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:20.443732 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5529f4-b738-41f2-b9ab-867117db4e89 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:20.505002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b72441-252e-44e0-831d-22fe8432082a None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:20.541539 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b323112-ab9f-4b8e-a769-4f52b426ac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:20.542459 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b323112-ab9f-4b8e-a769-4f52b426ac6d None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:20.542817 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b323112-ab9f-4b8e-a769-4f52b426ac6d None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:20.543222 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b323112-ab9f-4b8e-a769-4f52b426ac6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:20.554041 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5529f4-b738-41f2-b9ab-867117db4e89 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:20.555771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b323112-ab9f-4b8e-a769-4f52b426ac6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-3b323112-ab9f-4b8e-a769-4f52b426ac6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:20.564619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:20.565594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:20.566387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:20.566387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:20.566387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:20.566387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:20.566387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:20.566387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:20.566387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:20.566387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:20.566387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:20.566387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:20.566387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:20.566387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:20.566387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 238/483] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:25:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:20.567779 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b323112-ab9f-4b8e-a769-4f52b426ac6d None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:20.571452 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:20.573628 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:20.600384 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36efdd-dc06-43e4-8935-898550626e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:20.601149 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36efdd-dc06-43e4-8935-898550626e4c None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:20.601435 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36efdd-dc06-43e4-8935-898550626e4c None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:20.601707 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36efdd-dc06-43e4-8935-898550626e4c None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:20.602570 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36efdd-dc06-43e4-8935-898550626e4c None admin] RBAC: Adding query filter params (name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:20.602892 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36efdd-dc06-43e4-8935-898550626e4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:20.604272 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36efdd-dc06-43e4-8935-898550626e4c None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:20.617530 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 246/484] 10.222.0.86 () {56 vars in 1103 bytes} [Fri Jul 15 16:25:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:20.617530 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36efdd-dc06-43e4-8935-898550626e4c None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:20.675841 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b323112-ab9f-4b8e-a769-4f52b426ac6d None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:20.721359 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f396aa-1cdc-47e4-ba82-4e384321045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:20.722065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f396aa-1cdc-47e4-ba82-4e384321045c None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:20.722167 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36efdd-dc06-43e4-8935-898550626e4c None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:20.722348 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f396aa-1cdc-47e4-ba82-4e384321045c None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:20.722623 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f396aa-1cdc-47e4-ba82-4e384321045c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:20.733900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f396aa-1cdc-47e4-ba82-4e384321045c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-25f396aa-1cdc-47e4-ba82-4e384321045c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:20.741823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:20.742883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:20.743735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:20.743735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:20.743735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:20.743735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:20.743735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:20.743735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:20.743735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:20.743735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:20.743735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:20.743735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:20.743735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:20.743735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:20.743735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 239/485] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:25:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:20.744408 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f396aa-1cdc-47e4-ba82-4e384321045c None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:20.761666 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59af02-a9d1-4e61-9f38-1f47d184b115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:20.762328 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59af02-a9d1-4e61-9f38-1f47d184b115 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:20.762610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59af02-a9d1-4e61-9f38-1f47d184b115 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:20.762931 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59af02-a9d1-4e61-9f38-1f47d184b115 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:20.764307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59af02-a9d1-4e61-9f38-1f47d184b115 None admin] RBAC: Adding query filter params (name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:20.764613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59af02-a9d1-4e61-9f38-1f47d184b115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:20.765965 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59af02-a9d1-4e61-9f38-1f47d184b115 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:20.773944 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 247/486] 10.222.0.86 () {56 vars in 1103 bytes} [Fri Jul 15 16:25:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:20.775200 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85c506-a51f-44d9-838a-ab0fc064addf None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:20.775497 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85c506-a51f-44d9-838a-ab0fc064addf None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:20.775789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85c506-a51f-44d9-838a-ab0fc064addf None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:20.777020 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 248/487] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:20.777721 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85c506-a51f-44d9-838a-ab0fc064addf None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:20.809715 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:20.814567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:20.849080 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f396aa-1cdc-47e4-ba82-4e384321045c None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:20.882049 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85c506-a51f-44d9-838a-ab0fc064addf None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:20.885691 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d30bb-bcb9-4f6b-92ca-8ffef40ef6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:20.886540 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d30bb-bcb9-4f6b-92ca-8ffef40ef6fa None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:20.886828 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d30bb-bcb9-4f6b-92ca-8ffef40ef6fa None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:20.887153 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d30bb-bcb9-4f6b-92ca-8ffef40ef6fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:20.897548 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d30bb-bcb9-4f6b-92ca-8ffef40ef6fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:20.899032 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d30bb-bcb9-4f6b-92ca-8ffef40ef6fa None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:20.914392 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f4718-5143-46b7-b120-1a70df6c337d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:20.915071 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f4718-5143-46b7-b120-1a70df6c337d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:20.915356 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f4718-5143-46b7-b120-1a70df6c337d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:20.915633 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f4718-5143-46b7-b120-1a70df6c337d None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:20.915872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-693d30bb-bcb9-4f6b-92ca-8ffef40ef6fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:20.915872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:20.915872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:20.915872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:20.915872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:20.915872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:20.915872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:20.915872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:20.915872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:20.915872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:20.915872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:20.915872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:20.915872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:20.915872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:20.915872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:20.916666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:20.917526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:20.917526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:20.917526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:20.917526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:20.917729 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f4718-5143-46b7-b120-1a70df6c337d None admin] RBAC: Adding query filter params (name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:20.917729 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f4718-5143-46b7-b120-1a70df6c337d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:20.917864 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 240/488] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:20.917864 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d30bb-bcb9-4f6b-92ca-8ffef40ef6fa None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:20.917989 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f4718-5143-46b7-b120-1a70df6c337d None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:20.926342 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 249/489] 10.222.0.86 () {56 vars in 1103 bytes} [Fri Jul 15 16:25:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:20.927558 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10ca0f-1f6d-4920-85ee-a5a72446b6dc None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:20.927844 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10ca0f-1f6d-4920-85ee-a5a72446b6dc None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:20.928118 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10ca0f-1f6d-4920-85ee-a5a72446b6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:20.944207 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-5d10ca0f-1f6d-4920-85ee-a5a72446b6dc None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:20.945389 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-5d10ca0f-1f6d-4920-85ee-a5a72446b6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:21.011593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 250/490] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:21.012455 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10ca0f-1f6d-4920-85ee-a5a72446b6dc None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:21.024056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d30bb-bcb9-4f6b-92ca-8ffef40ef6fa None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:21.039301 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:21.054028 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:21.060352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d62af-6e90-476c-965a-1fb1dbb62adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:21.061140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d62af-6e90-476c-965a-1fb1dbb62adf None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:21.061425 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d62af-6e90-476c-965a-1fb1dbb62adf None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:21.061704 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d62af-6e90-476c-965a-1fb1dbb62adf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:21.072791 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d62af-6e90-476c-965a-1fb1dbb62adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:21.074256 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d62af-6e90-476c-965a-1fb1dbb62adf None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:21.092613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-f99d62af-6e90-476c-965a-1fb1dbb62adf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:21.092613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:21.092613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:21.092613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:21.092613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:21.092613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:21.092613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:21.092613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:21.092613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:21.092613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:21.092613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:21.092613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:21.092613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:21.092613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:21.092613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:21.093568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:21.094403 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:21.094403 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:21.094403 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:21.094403 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:21.094403 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 241/491] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:21.094660 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d62af-6e90-476c-965a-1fb1dbb62adf None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:21.131587 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10ca0f-1f6d-4920-85ee-a5a72446b6dc None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:21.164746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c07285-40fd-466a-8ab2-8154fffa783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:21.165421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c07285-40fd-466a-8ab2-8154fffa783d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:21.165709 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c07285-40fd-466a-8ab2-8154fffa783d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:21.165989 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c07285-40fd-466a-8ab2-8154fffa783d None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:21.166710 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c07285-40fd-466a-8ab2-8154fffa783d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:21.167054 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c07285-40fd-466a-8ab2-8154fffa783d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:21.168433 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c07285-40fd-466a-8ab2-8154fffa783d None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:21.179500 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 251/492] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:21.180382 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c07285-40fd-466a-8ab2-8154fffa783d None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:21.196402 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d62af-6e90-476c-965a-1fb1dbb62adf None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:21.230358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130df1b-8218-4121-92bf-f5ac3ae2add1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:21.231203 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130df1b-8218-4121-92bf-f5ac3ae2add1 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:21.231487 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130df1b-8218-4121-92bf-f5ac3ae2add1 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:21.231796 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130df1b-8218-4121-92bf-f5ac3ae2add1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:21.242050 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130df1b-8218-4121-92bf-f5ac3ae2add1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:21.243524 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130df1b-8218-4121-92bf-f5ac3ae2add1 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:21.260736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-e130df1b-8218-4121-92bf-f5ac3ae2add1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:21.260736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:21.260736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:21.260736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:21.260736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:21.260736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:21.260736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:21.260736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:21.260736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:21.260736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:21.260736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:21.260736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:21.260736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:21.260736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:21.260736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:21.261568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:21.262455 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:21.262455 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:21.262455 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:21.262455 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:21.262455 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 242/493] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:21.262736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130df1b-8218-4121-92bf-f5ac3ae2add1 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:21.271597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:21.282475 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:21.287416 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c07285-40fd-466a-8ab2-8154fffa783d None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:21.325465 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca99b66-4d43-42a7-9836-ff279e80f34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:21.326502 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca99b66-4d43-42a7-9836-ff279e80f34a None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:21.326784 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca99b66-4d43-42a7-9836-ff279e80f34a None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:21.327140 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca99b66-4d43-42a7-9836-ff279e80f34a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:21.336952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca99b66-4d43-42a7-9836-ff279e80f34a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-6ca99b66-4d43-42a7-9836-ff279e80f34a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:21.345156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:21.346151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:21.347002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:21.347002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:21.347002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:21.347002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:21.347002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:21.347002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:21.347002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:21.347002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:21.347002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:21.347002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:21.347002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:21.347002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:21.347002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 252/494] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:21.347881 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca99b66-4d43-42a7-9836-ff279e80f34a None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:21.368557 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130df1b-8218-4121-92bf-f5ac3ae2add1 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:21.402073 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a67ba1-3872-49a7-89c3-b68358e43958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:21.402727 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a67ba1-3872-49a7-89c3-b68358e43958 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:21.403043 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a67ba1-3872-49a7-89c3-b68358e43958 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:21.403325 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a67ba1-3872-49a7-89c3-b68358e43958 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:21.404074 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a67ba1-3872-49a7-89c3-b68358e43958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:21.404387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a67ba1-3872-49a7-89c3-b68358e43958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:21.405749 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a67ba1-3872-49a7-89c3-b68358e43958 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:21.417168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 243/495] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:21.417957 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a67ba1-3872-49a7-89c3-b68358e43958 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:21.443914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca99b66-4d43-42a7-9836-ff279e80f34a None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:21.476901 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b11827-b6e2-4c11-b938-a5c5f9501814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:21.477672 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b11827-b6e2-4c11-b938-a5c5f9501814 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:21.477959 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b11827-b6e2-4c11-b938-a5c5f9501814 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:21.478236 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b11827-b6e2-4c11-b938-a5c5f9501814 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:21.485594 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b11827-b6e2-4c11-b938-a5c5f9501814 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:21.487059 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b11827-b6e2-4c11-b938-a5c5f9501814 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:21.496801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-56b11827-b6e2-4c11-b938-a5c5f9501814 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:25:21.502602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:21.503695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:21.504658 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:21.504658 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:21.504658 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:25:21.504658 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:25:21.504658 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:25:21.504658 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:25:21.504658 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:25:21.504658 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:25:21.504658 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 16:25:21.504658 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:21.504658 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 253/496] 10.222.0.86 () {56 vars in 1093 bytes} [Fri Jul 15 16:25:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:21.504658 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b11827-b6e2-4c11-b938-a5c5f9501814 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:21.514311 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:21.525192 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a67ba1-3872-49a7-89c3-b68358e43958 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:21.559308 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5bc69-30b1-4854-b1d7-5899b8cf291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:21.560508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5bc69-30b1-4854-b1d7-5899b8cf291e None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:21.560808 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5bc69-30b1-4854-b1d7-5899b8cf291e None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:21.561085 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5bc69-30b1-4854-b1d7-5899b8cf291e None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:21.561806 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5bc69-30b1-4854-b1d7-5899b8cf291e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:21.562113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5bc69-30b1-4854-b1d7-5899b8cf291e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:21.563529 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5bc69-30b1-4854-b1d7-5899b8cf291e None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:21.574389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 244/497] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:21.575200 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5bc69-30b1-4854-b1d7-5899b8cf291e None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:21.605443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b11827-b6e2-4c11-b938-a5c5f9501814 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:21.638609 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61ca2b-51f8-4e35-a00b-1efbe522b081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:21.639296 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61ca2b-51f8-4e35-a00b-1efbe522b081 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:21.639578 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61ca2b-51f8-4e35-a00b-1efbe522b081 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:21.639852 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61ca2b-51f8-4e35-a00b-1efbe522b081 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:21.640591 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61ca2b-51f8-4e35-a00b-1efbe522b081 None admin] RBAC: Adding query filter params (name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:21.640896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61ca2b-51f8-4e35-a00b-1efbe522b081 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:21.642258 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61ca2b-51f8-4e35-a00b-1efbe522b081 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:21.649964 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 254/498] 10.222.0.86 () {56 vars in 1103 bytes} [Fri Jul 15 16:25:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:21.650737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61ca2b-51f8-4e35-a00b-1efbe522b081 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:21.679575 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5bc69-30b1-4854-b1d7-5899b8cf291e None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:21.713217 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fed889-75db-4721-acb9-68e55c0a5478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:21.714077 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fed889-75db-4721-acb9-68e55c0a5478 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:21.714373 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fed889-75db-4721-acb9-68e55c0a5478 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:21.714654 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fed889-75db-4721-acb9-68e55c0a5478 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:21.722133 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fed889-75db-4721-acb9-68e55c0a5478 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:21.723618 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fed889-75db-4721-acb9-68e55c0a5478 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:21.725339 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:21.725794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-38fed889-75db-4721-acb9-68e55c0a5478 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:25:21.742568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:21.743565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:21.744454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:21.744454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:21.744454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:25:21.744454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:25:21.744454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:25:21.744454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:25:21.744454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:25:21.744454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:25:21.744454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 16:25:21.744454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:21.744454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 245/499] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:21.745016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fed889-75db-4721-acb9-68e55c0a5478 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:21.765029 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61ca2b-51f8-4e35-a00b-1efbe522b081 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:21.799035 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9af50-4dc6-41f6-935d-1d554a4f36d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:21.799710 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9af50-4dc6-41f6-935d-1d554a4f36d2 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:21.799999 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9af50-4dc6-41f6-935d-1d554a4f36d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:21.800282 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9af50-4dc6-41f6-935d-1d554a4f36d2 None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:21.801127 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9af50-4dc6-41f6-935d-1d554a4f36d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:21.801438 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9af50-4dc6-41f6-935d-1d554a4f36d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:21.802895 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9af50-4dc6-41f6-935d-1d554a4f36d2 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:21.840151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 255/500] 10.222.0.86 () {56 vars in 1133 bytes} [Fri Jul 15 16:25:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:21.841003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9af50-4dc6-41f6-935d-1d554a4f36d2 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:21.845406 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fed889-75db-4721-acb9-68e55c0a5478 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:21.881822 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef117f-9d89-4ea8-bec8-7f1258365aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:21.882612 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef117f-9d89-4ea8-bec8-7f1258365aeb None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:21.882926 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef117f-9d89-4ea8-bec8-7f1258365aeb None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:21.883540 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef117f-9d89-4ea8-bec8-7f1258365aeb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:21.890819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef117f-9d89-4ea8-bec8-7f1258365aeb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:21.892335 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef117f-9d89-4ea8-bec8-7f1258365aeb None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-c4ef117f-9d89-4ea8-bec8-7f1258365aeb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:25:21.906840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:21.907896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:21.908835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:21.908835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:21.908835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:25:21.908835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:25:21.908835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:25:21.908835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:25:21.908835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:25:21.908835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:25:21.908835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 16:25:21.908835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:21.908835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 246/501] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:21.909409 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef117f-9d89-4ea8-bec8-7f1258365aeb None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:21.946298 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9af50-4dc6-41f6-935d-1d554a4f36d2 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:21.968692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:21.973119 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:21.982922 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed50c37-e2fd-4977-8343-0f32b85a1bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:21.983708 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed50c37-e2fd-4977-8343-0f32b85a1bf6 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:21.983990 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed50c37-e2fd-4977-8343-0f32b85a1bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:21.984266 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed50c37-e2fd-4977-8343-0f32b85a1bf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:21.994162 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed50c37-e2fd-4977-8343-0f32b85a1bf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:21.995673 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed50c37-e2fd-4977-8343-0f32b85a1bf6 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:22.010414 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef117f-9d89-4ea8-bec8-7f1258365aeb None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:22.014055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-6ed50c37-e2fd-4977-8343-0f32b85a1bf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:22.014055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:22.014055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:22.014055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:22.014055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:22.014055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:22.014055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:22.014055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:22.014055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:22.014055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:22.014055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:22.014055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:22.014055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:22.014055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:22.014055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:22.014898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:22.015789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:22.015789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:22.015789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:22.015789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:22.015789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 256/502] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:22.016327 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed50c37-e2fd-4977-8343-0f32b85a1bf6 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:22.047998 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0004a-748b-4d8f-8fd8-a6ad8109d36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:22.048661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0004a-748b-4d8f-8fd8-a6ad8109d36f None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:22.048943 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0004a-748b-4d8f-8fd8-a6ad8109d36f None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:22.049221 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0004a-748b-4d8f-8fd8-a6ad8109d36f None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:22.050050 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0004a-748b-4d8f-8fd8-a6ad8109d36f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:22.050360 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0004a-748b-4d8f-8fd8-a6ad8109d36f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:22.051820 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0004a-748b-4d8f-8fd8-a6ad8109d36f None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:22.088048 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 247/503] 10.222.0.86 () {56 vars in 1137 bytes} [Fri Jul 15 16:25:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:22.088889 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0004a-748b-4d8f-8fd8-a6ad8109d36f None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:22.120904 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed50c37-e2fd-4977-8343-0f32b85a1bf6 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:22.153539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9a800-8292-4de8-af24-2c22dca06209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:22.154687 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9a800-8292-4de8-af24-2c22dca06209 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:22.155000 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9a800-8292-4de8-af24-2c22dca06209 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:22.155400 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9a800-8292-4de8-af24-2c22dca06209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:22.189106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0004a-748b-4d8f-8fd8-a6ad8109d36f None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:22.201005 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:22.205735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:22.223887 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fb3ff-a142-4f30-b5e5-3f2cbb966ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:22.224065 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9a800-8292-4de8-af24-2c22dca06209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:22.224555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fb3ff-a142-4f30-b5e5-3f2cbb966ee2 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:22.224847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fb3ff-a142-4f30-b5e5-3f2cbb966ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:22.225130 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fb3ff-a142-4f30-b5e5-3f2cbb966ee2 None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:22.225409 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9a800-8292-4de8-af24-2c22dca06209 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:22.225960 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fb3ff-a142-4f30-b5e5-3f2cbb966ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:22.226276 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fb3ff-a142-4f30-b5e5-3f2cbb966ee2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:22.227766 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fb3ff-a142-4f30-b5e5-3f2cbb966ee2 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:22.244836 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 248/504] 10.222.0.86 () {56 vars in 1137 bytes} [Fri Jul 15 16:25:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:22.245639 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fb3ff-a142-4f30-b5e5-3f2cbb966ee2 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:22.323955 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 257/505] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:22.324883 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9a800-8292-4de8-af24-2c22dca06209 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:22.347593 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fb3ff-a142-4f30-b5e5-3f2cbb966ee2 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:22.381620 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc038a-5824-42e1-b450-ad2986b64e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:22.382281 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc038a-5824-42e1-b450-ad2986b64e20 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:22.382568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc038a-5824-42e1-b450-ad2986b64e20 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:22.382857 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc038a-5824-42e1-b450-ad2986b64e20 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:22.383606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc038a-5824-42e1-b450-ad2986b64e20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:22.383915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc038a-5824-42e1-b450-ad2986b64e20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:22.385306 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc038a-5824-42e1-b450-ad2986b64e20 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:22.396824 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 249/506] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:22.397624 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc038a-5824-42e1-b450-ad2986b64e20 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:22.409661 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:22.432431 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9a800-8292-4de8-af24-2c22dca06209 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:22.433321 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:22.466636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678a7fe-a5b0-475b-a0cc-2e45bd26463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:22.467313 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678a7fe-a5b0-475b-a0cc-2e45bd26463d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:22.467591 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678a7fe-a5b0-475b-a0cc-2e45bd26463d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:22.467871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678a7fe-a5b0-475b-a0cc-2e45bd26463d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:22.500122 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc038a-5824-42e1-b450-ad2986b64e20 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:22.532668 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a466f-9fee-41bf-a04e-ff36e401f6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:22.533309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a466f-9fee-41bf-a04e-ff36e401f6bd None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:22.533594 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a466f-9fee-41bf-a04e-ff36e401f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:22.533873 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a466f-9fee-41bf-a04e-ff36e401f6bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:22.534785 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678a7fe-a5b0-475b-a0cc-2e45bd26463d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:22.536227 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678a7fe-a5b0-475b-a0cc-2e45bd26463d None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:22.603067 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a466f-9fee-41bf-a04e-ff36e401f6bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:22.604439 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a466f-9fee-41bf-a04e-ff36e401f6bd None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:22.612108 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:22.635386 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 258/507] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:22.636208 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678a7fe-a5b0-475b-a0cc-2e45bd26463d None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:22.642523 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:22.704183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 250/508] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:22.705022 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a466f-9fee-41bf-a04e-ff36e401f6bd None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:22.738380 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678a7fe-a5b0-475b-a0cc-2e45bd26463d None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:22.773156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c15fee-eb55-4845-b349-4e39af05fbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:22.773965 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c15fee-eb55-4845-b349-4e39af05fbf9 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:22.774246 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c15fee-eb55-4845-b349-4e39af05fbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:22.774517 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c15fee-eb55-4845-b349-4e39af05fbf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:22.784539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c15fee-eb55-4845-b349-4e39af05fbf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:22.786067 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c15fee-eb55-4845-b349-4e39af05fbf9 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:22.803160 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a466f-9fee-41bf-a04e-ff36e401f6bd None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:22.803310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-d1c15fee-eb55-4845-b349-4e39af05fbf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:22.803310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:22.803310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:22.803310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:22.803310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:22.803310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:22.803310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:22.803310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:22.803310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:22.803310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:22.803310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:22.803310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:22.803310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:22.803310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:22.803310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:22.804276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:22.805163 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:22.805163 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:22.805163 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:22.805163 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:22.805163 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 259/509] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:22.805610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c15fee-eb55-4845-b349-4e39af05fbf9 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:22.836361 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:22.838790 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c3402-7bf9-4bd5-a6dc-255df0e1b7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:22.839622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c3402-7bf9-4bd5-a6dc-255df0e1b7b2 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:22.839907 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c3402-7bf9-4bd5-a6dc-255df0e1b7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:22.840182 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c3402-7bf9-4bd5-a6dc-255df0e1b7b2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:22.842110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:22.848929 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c3402-7bf9-4bd5-a6dc-255df0e1b7b2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:22.850375 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c3402-7bf9-4bd5-a6dc-255df0e1b7b2 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-496c3402-7bf9-4bd5-a6dc-255df0e1b7b2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:25:22.864606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:22.865490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:22.866356 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:22.866356 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:22.866356 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:25:22.866356 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:25:22.866356 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:25:22.866356 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:25:22.866356 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:25:22.866356 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:25:22.866356 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 16:25:22.866356 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:22.866356 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 251/510] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:25:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:22.867429 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c3402-7bf9-4bd5-a6dc-255df0e1b7b2 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:22.913171 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c15fee-eb55-4845-b349-4e39af05fbf9 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:22.946261 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc501d-c950-4a12-803a-bdd5ea8b76d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:22.947076 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc501d-c950-4a12-803a-bdd5ea8b76d0 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:22.947371 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc501d-c950-4a12-803a-bdd5ea8b76d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:22.947646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc501d-c950-4a12-803a-bdd5ea8b76d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:22.957769 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc501d-c950-4a12-803a-bdd5ea8b76d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:22.959238 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc501d-c950-4a12-803a-bdd5ea8b76d0 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:22.964541 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c3402-7bf9-4bd5-a6dc-255df0e1b7b2 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:22.976983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-84bc501d-c950-4a12-803a-bdd5ea8b76d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:22.976983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:22.976983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:22.976983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:22.976983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:22.976983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:22.976983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:22.976983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:22.976983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:22.976983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:22.976983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:22.976983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:22.976983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:22.976983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:22.976983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:22.977821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:22.978979 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:22.978979 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:22.978979 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:22.978979 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:22.978979 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 260/511] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:22.978979 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc501d-c950-4a12-803a-bdd5ea8b76d0 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:22.999009 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0062f-b259-4fd2-9f67-80d63309bf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:22.999798 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0062f-b259-4fd2-9f67-80d63309bf08 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:23.000084 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0062f-b259-4fd2-9f67-80d63309bf08 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:23.000363 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0062f-b259-4fd2-9f67-80d63309bf08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:23.010853 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0062f-b259-4fd2-9f67-80d63309bf08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:23.012340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0062f-b259-4fd2-9f67-80d63309bf08 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:23.030102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-e6a0062f-b259-4fd2-9f67-80d63309bf08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:23.030102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:23.030102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:23.030102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:23.030102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:23.030102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:23.030102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:23.030102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:23.030102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:23.030102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:23.030102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:23.030102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:23.030102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:23.030102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:23.030102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:23.030977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:23.031816 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:23.031816 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:23.031816 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:23.031816 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:23.031816 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 252/512] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:23.032124 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0062f-b259-4fd2-9f67-80d63309bf08 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:23.061662 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:23.078746 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:23.081147 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc501d-c950-4a12-803a-bdd5ea8b76d0 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:23.114489 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51510183-ee3d-47f7-9c4a-431235764a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:23.115240 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51510183-ee3d-47f7-9c4a-431235764a50 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:23.115460 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51510183-ee3d-47f7-9c4a-431235764a50 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:23.115738 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51510183-ee3d-47f7-9c4a-431235764a50 None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:23.116452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51510183-ee3d-47f7-9c4a-431235764a50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:23.116766 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51510183-ee3d-47f7-9c4a-431235764a50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:23.118130 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51510183-ee3d-47f7-9c4a-431235764a50 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:23.129321 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 261/513] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:23.130027 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51510183-ee3d-47f7-9c4a-431235764a50 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:23.137116 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0062f-b259-4fd2-9f67-80d63309bf08 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:23.173325 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521a4dd-291c-436f-9895-f4e89f59805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:23.173989 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521a4dd-291c-436f-9895-f4e89f59805b None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:23.174279 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521a4dd-291c-436f-9895-f4e89f59805b None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:23.174558 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521a4dd-291c-436f-9895-f4e89f59805b None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:23.175423 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521a4dd-291c-436f-9895-f4e89f59805b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:23.175737 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521a4dd-291c-436f-9895-f4e89f59805b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:23.177164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521a4dd-291c-436f-9895-f4e89f59805b None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:23.193872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 253/514] 10.222.0.86 () {56 vars in 1139 bytes} [Fri Jul 15 16:25:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:23.194662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521a4dd-291c-436f-9895-f4e89f59805b None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:23.229143 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51510183-ee3d-47f7-9c4a-431235764a50 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:23.261593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49501c17-9cc4-4d47-8db2-eb688bab01b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:23.262243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49501c17-9cc4-4d47-8db2-eb688bab01b7 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:23.262525 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49501c17-9cc4-4d47-8db2-eb688bab01b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:23.262798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49501c17-9cc4-4d47-8db2-eb688bab01b7 None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:23.264042 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49501c17-9cc4-4d47-8db2-eb688bab01b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:23.264349 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49501c17-9cc4-4d47-8db2-eb688bab01b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:23.265700 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49501c17-9cc4-4d47-8db2-eb688bab01b7 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:23.277075 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 262/515] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:23.278055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49501c17-9cc4-4d47-8db2-eb688bab01b7 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:23.281242 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:23.302223 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521a4dd-291c-436f-9895-f4e89f59805b None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:23.304701 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:23.337457 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcb8d6-3b86-4286-a614-1129566036d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:23.338115 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcb8d6-3b86-4286-a614-1129566036d8 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:23.338398 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcb8d6-3b86-4286-a614-1129566036d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:23.338674 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcb8d6-3b86-4286-a614-1129566036d8 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:23.339413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcb8d6-3b86-4286-a614-1129566036d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:23.339724 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcb8d6-3b86-4286-a614-1129566036d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:23.341099 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcb8d6-3b86-4286-a614-1129566036d8 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:23.352098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 254/516] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:23.352877 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcb8d6-3b86-4286-a614-1129566036d8 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:23.387084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49501c17-9cc4-4d47-8db2-eb688bab01b7 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:23.421310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63f56c-86b7-4571-b07e-82a4156cab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:23.422068 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63f56c-86b7-4571-b07e-82a4156cab8c None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:23.422347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63f56c-86b7-4571-b07e-82a4156cab8c None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:23.422619 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63f56c-86b7-4571-b07e-82a4156cab8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:23.429119 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63f56c-86b7-4571-b07e-82a4156cab8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:23.430577 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63f56c-86b7-4571-b07e-82a4156cab8c None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:23.444733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-2e63f56c-86b7-4571-b07e-82a4156cab8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:23.444733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:23.444733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:23.444733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:23.444733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:23.444733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:23.444733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:23.444733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:23.444733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:23.444733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:23.444733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:23.444733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:23.444733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:25:23.444733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:25:23.444733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:23.445688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:23.446531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:25:23.446531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:25:23.446531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:25:23.446531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:25:23.446531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:25:23.446531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:25:23.446531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:23.446531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:23.446531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 263/517] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:23.447031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63f56c-86b7-4571-b07e-82a4156cab8c None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:23.455726 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcb8d6-3b86-4286-a614-1129566036d8 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:23.489946 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc60f5-1b6e-4e78-94e0-e9cea82875c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:23.490586 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc60f5-1b6e-4e78-94e0-e9cea82875c9 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:23.490918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc60f5-1b6e-4e78-94e0-e9cea82875c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:23.491170 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc60f5-1b6e-4e78-94e0-e9cea82875c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:23.506648 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:23.520626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:23.547854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63f56c-86b7-4571-b07e-82a4156cab8c None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:23.557827 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc60f5-1b6e-4e78-94e0-e9cea82875c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:23.559305 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc60f5-1b6e-4e78-94e0-e9cea82875c9 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:23.580115 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61284c57-749d-4d1e-8ac2-2e36fb3ace0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:23.580887 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61284c57-749d-4d1e-8ac2-2e36fb3ace0a None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:23.581169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61284c57-749d-4d1e-8ac2-2e36fb3ace0a None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:23.581445 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61284c57-749d-4d1e-8ac2-2e36fb3ace0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:23.587851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61284c57-749d-4d1e-8ac2-2e36fb3ace0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:23.589261 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61284c57-749d-4d1e-8ac2-2e36fb3ace0a None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:23.603783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-61284c57-749d-4d1e-8ac2-2e36fb3ace0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:23.603783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:23.603783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:23.603783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:23.603783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:23.603783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:23.603783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:23.603783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:23.603783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:23.603783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:23.603783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:23.603783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:23.603783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:25:23.603783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:25:23.603783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:23.604604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:23.605447 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:25:23.605447 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:25:23.605447 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:25:23.605447 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:25:23.605447 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:25:23.605447 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:25:23.605447 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:23.605447 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:23.607498 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 264/518] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:23.608600 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61284c57-749d-4d1e-8ac2-2e36fb3ace0a None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:23.655617 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 255/519] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:23.656456 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc60f5-1b6e-4e78-94e0-e9cea82875c9 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:23.711338 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61284c57-749d-4d1e-8ac2-2e36fb3ace0a None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:23.719389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:23.735382 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:23.746898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77fd0f-f822-4953-ae25-53e50d2b5f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:23.747712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fd0f-f822-4953-ae25-53e50d2b5f42 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:23.748003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fd0f-f822-4953-ae25-53e50d2b5f42 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:23.748275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fd0f-f822-4953-ae25-53e50d2b5f42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:23.754830 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77fd0f-f822-4953-ae25-53e50d2b5f42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:23.756291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77fd0f-f822-4953-ae25-53e50d2b5f42 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:23.757472 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc60f5-1b6e-4e78-94e0-e9cea82875c9 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:23.770494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-ae77fd0f-f822-4953-ae25-53e50d2b5f42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:23.770494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:23.770494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:23.770494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:23.770494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:23.770494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:23.770494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:23.770494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:23.770494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:23.770494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:23.770494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:23.770494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:23.770494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:25:23.770494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:25:23.770494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:23.771572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:23.772448 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:25:23.772448 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:25:23.772448 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:25:23.772448 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:25:23.772448 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:25:23.772448 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:25:23.772448 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:23.772448 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:23.772448 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 265/520] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:23.772448 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77fd0f-f822-4953-ae25-53e50d2b5f42 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:23.795277 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78378aab-add2-447e-9264-72f37954fe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:23.795997 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78378aab-add2-447e-9264-72f37954fe64 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:23.796284 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78378aab-add2-447e-9264-72f37954fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:23.796559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78378aab-add2-447e-9264-72f37954fe64 None admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:23.797335 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78378aab-add2-447e-9264-72f37954fe64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:23.797644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78378aab-add2-447e-9264-72f37954fe64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:23.799084 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78378aab-add2-447e-9264-72f37954fe64 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:23.816036 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 256/521] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:25:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:23.816828 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78378aab-add2-447e-9264-72f37954fe64 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:23.875321 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77fd0f-f822-4953-ae25-53e50d2b5f42 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:23.908749 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74bf9b-252f-4288-bb13-a65d1d164aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:23.909331 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74bf9b-252f-4288-bb13-a65d1d164aef None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:23.909618 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74bf9b-252f-4288-bb13-a65d1d164aef None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:23.909904 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74bf9b-252f-4288-bb13-a65d1d164aef None admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:23.910680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74bf9b-252f-4288-bb13-a65d1d164aef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:23.911032 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74bf9b-252f-4288-bb13-a65d1d164aef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:23.912462 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74bf9b-252f-4288-bb13-a65d1d164aef None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:23.915431 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78378aab-add2-447e-9264-72f37954fe64 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:23.929874 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 266/522] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:25:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:23.930700 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74bf9b-252f-4288-bb13-a65d1d164aef None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:23.940376 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:23.952071 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dbb1c-6101-4d03-b974-2c1ea9519406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:23.952865 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dbb1c-6101-4d03-b974-2c1ea9519406 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:23.953167 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dbb1c-6101-4d03-b974-2c1ea9519406 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:23.953426 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dbb1c-6101-4d03-b974-2c1ea9519406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:23.963845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dbb1c-6101-4d03-b974-2c1ea9519406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:23.965300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dbb1c-6101-4d03-b974-2c1ea9519406 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:23.974118 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:23.983190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-3b3dbb1c-6101-4d03-b974-2c1ea9519406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:23.983190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:23.983190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:23.983190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:23.983190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:23.983190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:23.983190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:23.983190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:23.983190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:23.983190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:23.983190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:23.983190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:23.983190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:23.983190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:23.983190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:23.984088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:23.984920 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:23.984920 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:23.984920 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:23.984920 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:23.984920 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 257/523] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:23.985514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dbb1c-6101-4d03-b974-2c1ea9519406 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:24.032758 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74bf9b-252f-4288-bb13-a65d1d164aef None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:24.065831 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22b38c-1e66-4c15-87ba-14312669eb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:24.066488 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22b38c-1e66-4c15-87ba-14312669eb96 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:24.066769 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22b38c-1e66-4c15-87ba-14312669eb96 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:24.067077 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22b38c-1e66-4c15-87ba-14312669eb96 None admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:24.067861 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22b38c-1e66-4c15-87ba-14312669eb96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:24.068172 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22b38c-1e66-4c15-87ba-14312669eb96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:24.069623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22b38c-1e66-4c15-87ba-14312669eb96 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:24.081566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 267/524] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:25:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:24.082353 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22b38c-1e66-4c15-87ba-14312669eb96 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:24.084662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dbb1c-6101-4d03-b974-2c1ea9519406 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:24.118138 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16dfed-c546-4370-aa91-97809ba67a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:24.118780 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16dfed-c546-4370-aa91-97809ba67a79 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:24.119084 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16dfed-c546-4370-aa91-97809ba67a79 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:24.119361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16dfed-c546-4370-aa91-97809ba67a79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:24.120177 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16dfed-c546-4370-aa91-97809ba67a79 None admin] RBAC: Adding query filter params (role.id=0d630eb5fff7436391281167da032c15, scope.project.id=db599cc43051468cbf306faba2431b23, user.id=f34916bd4d56411e8994d1c476885e2e) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:24.120488 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16dfed-c546-4370-aa91-97809ba67a79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:24.121922 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16dfed-c546-4370-aa91-97809ba67a79 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:24.127889 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 258/525] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:25:23 2022] GET /identity/v3/role_assignments?user.id=f34916bd4d56411e8994d1c476885e2e&scope.project.id=db599cc43051468cbf306faba2431b23&role.id=0d630eb5fff7436391281167da032c15 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:24.128654 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16dfed-c546-4370-aa91-97809ba67a79 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:24.177865 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:24.201241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22b38c-1e66-4c15-87ba-14312669eb96 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:24.203041 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:24.240776 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04733e0b-855f-40d0-be06-db2040d7c24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:24.241472 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04733e0b-855f-40d0-be06-db2040d7c24c None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:24.241720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04733e0b-855f-40d0-be06-db2040d7c24c None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:24.241998 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04733e0b-855f-40d0-be06-db2040d7c24c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:24.242855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04733e0b-855f-40d0-be06-db2040d7c24c None admin] RBAC: Adding query filter params (role.id=0d630eb5fff7436391281167da032c15, scope.project.id=db599cc43051468cbf306faba2431b23, user.id=2a518605222244f2974ab19a03e4cf93) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:24.243205 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04733e0b-855f-40d0-be06-db2040d7c24c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:24.244671 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04733e0b-855f-40d0-be06-db2040d7c24c None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:24.245699 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16dfed-c546-4370-aa91-97809ba67a79 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:24.251950 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 268/526] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:25:24 2022] GET /identity/v3/role_assignments?user.id=2a518605222244f2974ab19a03e4cf93&scope.project.id=db599cc43051468cbf306faba2431b23&role.id=0d630eb5fff7436391281167da032c15 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:24.260342 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04733e0b-855f-40d0-be06-db2040d7c24c None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:24.286614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec820c-66e8-4272-91b6-69de16fd1954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:24.287343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec820c-66e8-4272-91b6-69de16fd1954 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:24.287639 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec820c-66e8-4272-91b6-69de16fd1954 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:24.287919 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec820c-66e8-4272-91b6-69de16fd1954 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:24.288737 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec820c-66e8-4272-91b6-69de16fd1954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:24.288998 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec820c-66e8-4272-91b6-69de16fd1954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:24.290474 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec820c-66e8-4272-91b6-69de16fd1954 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:24.310156 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 259/527] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:24.311186 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec820c-66e8-4272-91b6-69de16fd1954 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:24.398264 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04733e0b-855f-40d0-be06-db2040d7c24c None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:24.435491 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:24.438554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d4062-da67-4d4b-b474-3c8fd8c8fee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:24.439494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d4062-da67-4d4b-b474-3c8fd8c8fee8 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:24.439609 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec820c-66e8-4272-91b6-69de16fd1954 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:24.440010 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d4062-da67-4d4b-b474-3c8fd8c8fee8 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:24.440425 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d4062-da67-4d4b-b474-3c8fd8c8fee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:24.441563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d4062-da67-4d4b-b474-3c8fd8c8fee8 None admin] RBAC: Adding query filter params (role.id=0d630eb5fff7436391281167da032c15, scope.project.id=db599cc43051468cbf306faba2431b23, user.id=a101281ae1f2474886c1ec214f042d24) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:24.442085 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d4062-da67-4d4b-b474-3c8fd8c8fee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:24.443771 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d4062-da67-4d4b-b474-3c8fd8c8fee8 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:24.450525 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 269/528] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:25:24 2022] GET /identity/v3/role_assignments?user.id=a101281ae1f2474886c1ec214f042d24&scope.project.id=db599cc43051468cbf306faba2431b23&role.id=0d630eb5fff7436391281167da032c15 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:24.480205 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81673e-9b72-435d-b49b-0ed62da57228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:24.481036 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81673e-9b72-435d-b49b-0ed62da57228 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:24.481323 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81673e-9b72-435d-b49b-0ed62da57228 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:24.481638 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81673e-9b72-435d-b49b-0ed62da57228 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:24.490442 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81673e-9b72-435d-b49b-0ed62da57228 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:24.491978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81673e-9b72-435d-b49b-0ed62da57228 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:24.508370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-da81673e-9b72-435d-b49b-0ed62da57228 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:24.508370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:24.508370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:24.508370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:24.508370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:24.508370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:24.508370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:24.508370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:24.508370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:24.508370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:24.508370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:24.508370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:24.508370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:25:24.508370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:25:24.508370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:24.509297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:24.510164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:25:24.510164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:25:24.510164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:25:24.510164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:25:24.510164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:25:24.510164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:25:24.510164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:24.510164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:24.510164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 260/529] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:24.516751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d4062-da67-4d4b-b474-3c8fd8c8fee8 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:24.552080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:24.633612 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d4062-da67-4d4b-b474-3c8fd8c8fee8 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:24.672209 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b9e72-a30f-48f9-a35f-b40b76d22e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:24.673328 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b9e72-a30f-48f9-a35f-b40b76d22e7f None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:24.673810 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b9e72-a30f-48f9-a35f-b40b76d22e7f None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:24.674295 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b9e72-a30f-48f9-a35f-b40b76d22e7f None admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:24.675294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b9e72-a30f-48f9-a35f-b40b76d22e7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:24.675812 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b9e72-a30f-48f9-a35f-b40b76d22e7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:24.677489 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b9e72-a30f-48f9-a35f-b40b76d22e7f None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:24.691041 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 270/530] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:24.698984 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81673e-9b72-435d-b49b-0ed62da57228 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:24.808530 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81673e-9b72-435d-b49b-0ed62da57228 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:24.844911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9001e46-e55c-4bec-9ad5-986ef82d1515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:24.845579 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9001e46-e55c-4bec-9ad5-986ef82d1515 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:24.845862 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9001e46-e55c-4bec-9ad5-986ef82d1515 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:24.846142 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9001e46-e55c-4bec-9ad5-986ef82d1515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:24.847007 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9001e46-e55c-4bec-9ad5-986ef82d1515 None admin] RBAC: Adding query filter params (role.id=0d630eb5fff7436391281167da032c15, scope.project.id=db599cc43051468cbf306faba2431b23, user.id=8e620f2a895241279b63327d6a7d3dae) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:24.847327 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9001e46-e55c-4bec-9ad5-986ef82d1515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:24.848881 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9001e46-e55c-4bec-9ad5-986ef82d1515 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:24.855090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 261/531] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:25:24 2022] GET /identity/v3/role_assignments?user.id=8e620f2a895241279b63327d6a7d3dae&scope.project.id=db599cc43051468cbf306faba2431b23&role.id=0d630eb5fff7436391281167da032c15 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:26.405348 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c137232-3e86-42cf-9005-b3198cb1fae9 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:26.406395 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c137232-3e86-42cf-9005-b3198cb1fae9 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:26.406973 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c137232-3e86-42cf-9005-b3198cb1fae9 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:26.408646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 271/532] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:26.414757 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071569b-1f18-4cc0-9d1a-ebf483225d6f None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:26.415292 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071569b-1f18-4cc0-9d1a-ebf483225d6f None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:26.415367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071569b-1f18-4cc0-9d1a-ebf483225d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:26.434428 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-c071569b-1f18-4cc0-9d1a-ebf483225d6f None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:26.436247 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-c071569b-1f18-4cc0-9d1a-ebf483225d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:26.457471 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:26.510153 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 262/533] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:26.533589 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c137232-3e86-42cf-9005-b3198cb1fae9 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:26.601792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd495e3-277d-462e-b34b-c11373cf7f03 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:26.602095 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd495e3-277d-462e-b34b-c11373cf7f03 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:26.602361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd495e3-277d-462e-b34b-c11373cf7f03 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:26.604061 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 263/534] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:25:26.609918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e700128-d726-4604-b0ed-47ce3a922ba7 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:26.610235 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e700128-d726-4604-b0ed-47ce3a922ba7 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:26.610483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e700128-d726-4604-b0ed-47ce3a922ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:26.629520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-2e700128-d726-4604-b0ed-47ce3a922ba7 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:26.630720 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-2e700128-d726-4604-b0ed-47ce3a922ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:26.648978 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:26.651369 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c137232-3e86-42cf-9005-b3198cb1fae9 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:26.690011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832aa3a-ebfe-47df-b15d-53c62ed582f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:26.690807 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832aa3a-ebfe-47df-b15d-53c62ed582f7 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:26.691120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832aa3a-ebfe-47df-b15d-53c62ed582f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:26.691402 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832aa3a-ebfe-47df-b15d-53c62ed582f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:26.703758 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832aa3a-ebfe-47df-b15d-53c62ed582f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:26.711236 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 264/535] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-5832aa3a-ebfe-47df-b15d-53c62ed582f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:26.714896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:26.715757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:26.716593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:26.716593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:26.716593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:26.716593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:26.716593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:26.716593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:26.716593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:26.716593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:26.716593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:26.716593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:26.716593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:26.716593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:26.716593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 272/536] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:25:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:26.722012 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e700128-d726-4604-b0ed-47ce3a922ba7 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:26.731823 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832aa3a-ebfe-47df-b15d-53c62ed582f7 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:26.822186 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:26.840297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e700128-d726-4604-b0ed-47ce3a922ba7 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:26.859724 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832aa3a-ebfe-47df-b15d-53c62ed582f7 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:26.881192 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4770f-aa0d-4c59-a7ff-14eedd954228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:26.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4770f-aa0d-4c59-a7ff-14eedd954228 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:26.882300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4770f-aa0d-4c59-a7ff-14eedd954228 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:26.882636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4770f-aa0d-4c59-a7ff-14eedd954228 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:26.883502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4770f-aa0d-4c59-a7ff-14eedd954228 None admin] RBAC: Adding query filter params (name=service) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:26.883876 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4770f-aa0d-4c59-a7ff-14eedd954228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:26.885384 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4770f-aa0d-4c59-a7ff-14eedd954228 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:26.894418 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 265/537] 10.222.0.86 () {56 vars in 1103 bytes} [Fri Jul 15 16:25:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:26.896006 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9f3ca-f3f8-4d64-a01d-3c337bf02867 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:26.896369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9f3ca-f3f8-4d64-a01d-3c337bf02867 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:26.896720 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9f3ca-f3f8-4d64-a01d-3c337bf02867 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:26.898156 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 266/538] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:26.900478 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9f3ca-f3f8-4d64-a01d-3c337bf02867 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:26.907775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08671da1-bd3c-465c-846f-a3983698dad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:26.908581 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08671da1-bd3c-465c-846f-a3983698dad5 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:26.908866 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08671da1-bd3c-465c-846f-a3983698dad5 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:26.909143 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08671da1-bd3c-465c-846f-a3983698dad5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:26.920719 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08671da1-bd3c-465c-846f-a3983698dad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-08671da1-bd3c-465c-846f-a3983698dad5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:26.928496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:26.929363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:26.931611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:26.931611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:26.931611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:26.931611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:26.931611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:26.931611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:26.931611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:26.931611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:26.931611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:26.931611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:26.931611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:26.931611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:26.931611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 273/539] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:25:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:26.931611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac321-d0f0-4acd-acb2-d33ce0575796 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:26.932348 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac321-d0f0-4acd-acb2-d33ce0575796 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:26.932348 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac321-d0f0-4acd-acb2-d33ce0575796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:26.948076 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-516ac321-d0f0-4acd-acb2-d33ce0575796 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:26.949284 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-516ac321-d0f0-4acd-acb2-d33ce0575796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:26.953101 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:27.031593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 274/540] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:27.031593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ac321-d0f0-4acd-acb2-d33ce0575796 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:27.033417 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9f3ca-f3f8-4d64-a01d-3c337bf02867 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:27.072137 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8b421-b7c0-42e2-af63-e8c38533041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:27.072937 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8b421-b7c0-42e2-af63-e8c38533041d None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:27.073223 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8b421-b7c0-42e2-af63-e8c38533041d None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:27.073507 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8b421-b7c0-42e2-af63-e8c38533041d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:27.084404 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8b421-b7c0-42e2-af63-e8c38533041d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:27.085848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8b421-b7c0-42e2-af63-e8c38533041d None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:27.092230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:27.104140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-18c8b421-b7c0-42e2-af63-e8c38533041d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:27.104140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:27.104140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:27.104140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:27.104140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:27.104140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:27.104140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:27.104140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:27.104140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:27.104140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:27.104140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:27.104140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:27.104140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:27.104140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:27.104140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:27.105102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:27.106148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:27.106148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:27.106148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:27.106148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:27.108495 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 267/541] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:27.109294 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8b421-b7c0-42e2-af63-e8c38533041d None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:27.137730 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ac321-d0f0-4acd-acb2-d33ce0575796 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:27.171851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c44f3-3aae-41fb-83c8-5687ba1b88d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:27.172514 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c44f3-3aae-41fb-83c8-5687ba1b88d7 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:27.172799 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c44f3-3aae-41fb-83c8-5687ba1b88d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:27.173080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c44f3-3aae-41fb-83c8-5687ba1b88d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:27.173826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c44f3-3aae-41fb-83c8-5687ba1b88d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:27.174137 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c44f3-3aae-41fb-83c8-5687ba1b88d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:27.175545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c44f3-3aae-41fb-83c8-5687ba1b88d7 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:27.183290 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 275/542] 10.222.0.86 () {56 vars in 1103 bytes} [Fri Jul 15 16:25:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:27.184160 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c44f3-3aae-41fb-83c8-5687ba1b88d7 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:27.189996 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:27.209809 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8b421-b7c0-42e2-af63-e8c38533041d None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:27.243551 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08059146-3bd4-4e81-b389-9a2936ea7f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:27.244336 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08059146-3bd4-4e81-b389-9a2936ea7f1f None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:27.244621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08059146-3bd4-4e81-b389-9a2936ea7f1f None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:27.244897 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08059146-3bd4-4e81-b389-9a2936ea7f1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:27.254984 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08059146-3bd4-4e81-b389-9a2936ea7f1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-08059146-3bd4-4e81-b389-9a2936ea7f1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:27.262559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:27.263646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:27.264728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:27.264728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:27.264728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:27.264728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:27.264728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:27.264728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:27.264728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:27.264728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:27.264728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:27.264728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:27.264728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:27.264728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:27.264728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 268/543] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:25:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:27.265605 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd12a27-6e81-4215-a233-74bc549b1d25 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:27.265693 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd12a27-6e81-4215-a233-74bc549b1d25 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:27.265914 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd12a27-6e81-4215-a233-74bc549b1d25 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:27.270224 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 269/544] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:27.270224 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd12a27-6e81-4215-a233-74bc549b1d25 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:27.290742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c44f3-3aae-41fb-83c8-5687ba1b88d7 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:27.324407 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900b280-164c-4ccd-8491-03fb6a0c226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:27.325089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900b280-164c-4ccd-8491-03fb6a0c226d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:27.325399 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900b280-164c-4ccd-8491-03fb6a0c226d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:27.325933 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900b280-164c-4ccd-8491-03fb6a0c226d None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:27.326685 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900b280-164c-4ccd-8491-03fb6a0c226d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:27.327022 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900b280-164c-4ccd-8491-03fb6a0c226d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:27.327411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:27.328407 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900b280-164c-4ccd-8491-03fb6a0c226d None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:27.340461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 276/545] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:27.341748 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900b280-164c-4ccd-8491-03fb6a0c226d None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:27.372062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd12a27-6e81-4215-a233-74bc549b1d25 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:27.404221 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ebcc0-5b6b-412e-bd1d-d37ded145664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:27.405012 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ebcc0-5b6b-412e-bd1d-d37ded145664 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:27.405291 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ebcc0-5b6b-412e-bd1d-d37ded145664 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:27.405558 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ebcc0-5b6b-412e-bd1d-d37ded145664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:27.409717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:27.416907 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ebcc0-5b6b-412e-bd1d-d37ded145664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:27.418549 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ebcc0-5b6b-412e-bd1d-d37ded145664 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:27.436697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-357ebcc0-5b6b-412e-bd1d-d37ded145664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:27.436697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:27.436697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:27.436697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:27.436697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:27.436697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:27.436697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:27.436697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:27.436697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:27.436697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:27.436697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:27.436697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:27.436697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:27.436697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:27.436697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:27.437628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:27.438662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:27.438662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:27.438662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:27.438662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:27.438662 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 270/546] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:27.439314 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bed4fb-0b11-4bee-b48e-5bd2c76baf8d None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:27.439429 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bed4fb-0b11-4bee-b48e-5bd2c76baf8d None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:27.439719 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bed4fb-0b11-4bee-b48e-5bd2c76baf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:27.454956 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900b280-164c-4ccd-8491-03fb6a0c226d None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:27.455597 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-43bed4fb-0b11-4bee-b48e-5bd2c76baf8d None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:27.456781 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-43bed4fb-0b11-4bee-b48e-5bd2c76baf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:27.491019 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222872aa-8d2a-44d6-9c23-ffb4466e00bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:27.491607 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222872aa-8d2a-44d6-9c23-ffb4466e00bc None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:27.491887 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222872aa-8d2a-44d6-9c23-ffb4466e00bc None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:27.492161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222872aa-8d2a-44d6-9c23-ffb4466e00bc None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:27.492900 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222872aa-8d2a-44d6-9c23-ffb4466e00bc None admin] RBAC: Adding query filter params (name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:27.493202 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222872aa-8d2a-44d6-9c23-ffb4466e00bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:27.494551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222872aa-8d2a-44d6-9c23-ffb4466e00bc None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:27.502988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 277/547] 10.222.0.86 () {56 vars in 1103 bytes} [Fri Jul 15 16:25:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:27.503838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222872aa-8d2a-44d6-9c23-ffb4466e00bc None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:27.527172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 271/548] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:27.528007 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bed4fb-0b11-4bee-b48e-5bd2c76baf8d None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:27.576152 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:27.603157 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222872aa-8d2a-44d6-9c23-ffb4466e00bc None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:27.626062 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:27.633956 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bed4fb-0b11-4bee-b48e-5bd2c76baf8d None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:27.637043 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593e4e2-141a-4367-8a49-758a69364a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:27.638422 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593e4e2-141a-4367-8a49-758a69364a67 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:27.638793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593e4e2-141a-4367-8a49-758a69364a67 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:27.639120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593e4e2-141a-4367-8a49-758a69364a67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:27.646649 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593e4e2-141a-4367-8a49-758a69364a67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:27.648134 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593e4e2-141a-4367-8a49-758a69364a67 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-d593e4e2-141a-4367-8a49-758a69364a67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:25:27.662499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:27.663596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:27.664677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:27.664677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:27.664677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:25:27.664677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:25:27.664677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:25:27.664677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:25:27.664677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:25:27.664677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:25:27.664677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 16:25:27.664677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:27.666591 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 278/549] 10.222.0.86 () {56 vars in 1093 bytes} [Fri Jul 15 16:25:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:27.667503 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593e4e2-141a-4367-8a49-758a69364a67 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:27.668792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbe48f-9c1d-4afa-8335-440e98563dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:27.669489 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbe48f-9c1d-4afa-8335-440e98563dc7 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:27.669774 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbe48f-9c1d-4afa-8335-440e98563dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:27.670315 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbe48f-9c1d-4afa-8335-440e98563dc7 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:27.672080 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbe48f-9c1d-4afa-8335-440e98563dc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:27.672394 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbe48f-9c1d-4afa-8335-440e98563dc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:27.673752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbe48f-9c1d-4afa-8335-440e98563dc7 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:27.685498 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 272/550] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:27.686373 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbe48f-9c1d-4afa-8335-440e98563dc7 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:27.765736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593e4e2-141a-4367-8a49-758a69364a67 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:27.782385 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:27.785324 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbe48f-9c1d-4afa-8335-440e98563dc7 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:27.798436 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f323a2-71c2-4e20-80fc-833ebe7684ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:27.799249 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f323a2-71c2-4e20-80fc-833ebe7684ba None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:27.799532 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f323a2-71c2-4e20-80fc-833ebe7684ba None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:27.799807 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f323a2-71c2-4e20-80fc-833ebe7684ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:27.810081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f323a2-71c2-4e20-80fc-833ebe7684ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:27.811550 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f323a2-71c2-4e20-80fc-833ebe7684ba None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:27.817574 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85219742-8d0c-46d5-9a71-3ea641fb3f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:27.818350 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85219742-8d0c-46d5-9a71-3ea641fb3f30 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:27.818632 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85219742-8d0c-46d5-9a71-3ea641fb3f30 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:27.818931 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85219742-8d0c-46d5-9a71-3ea641fb3f30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:27.828568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-17f323a2-71c2-4e20-80fc-833ebe7684ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:27.828568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:27.828568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:27.828568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:27.828568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:27.828568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:27.828568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:27.828568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:27.828568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:27.828568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:27.828568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:27.828568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:27.828568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:27.828568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:27.828568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:27.829408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:27.830252 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:27.830252 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:27.830252 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:27.830252 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:27.830561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85219742-8d0c-46d5-9a71-3ea641fb3f30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:27.830636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 279/551] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:27.830636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f323a2-71c2-4e20-80fc-833ebe7684ba None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-85219742-8d0c-46d5-9a71-3ea641fb3f30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:27.837125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:27.838353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:27.840343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:27.840343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:27.840343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:27.840343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:27.840343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:27.840343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:27.840343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:27.840343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:27.840343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:27.840343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:27.840343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:27.840343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:27.840343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 273/552] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:25:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:27.840343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85219742-8d0c-46d5-9a71-3ea641fb3f30 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:27.869563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:27.934570 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f323a2-71c2-4e20-80fc-833ebe7684ba None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:27.941342 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85219742-8d0c-46d5-9a71-3ea641fb3f30 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:27.968823 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81627653-00b0-46ce-9b7a-4c96378570c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:27.969587 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81627653-00b0-46ce-9b7a-4c96378570c4 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:27.969880 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81627653-00b0-46ce-9b7a-4c96378570c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:27.970156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81627653-00b0-46ce-9b7a-4c96378570c4 None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:27.971018 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81627653-00b0-46ce-9b7a-4c96378570c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:27.971338 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81627653-00b0-46ce-9b7a-4c96378570c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:27.972790 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81627653-00b0-46ce-9b7a-4c96378570c4 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:27.974337 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a696c-bde2-4575-9a0b-8acb941e4ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:27.975147 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a696c-bde2-4575-9a0b-8acb941e4ae6 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:27.975429 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a696c-bde2-4575-9a0b-8acb941e4ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:27.975703 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a696c-bde2-4575-9a0b-8acb941e4ae6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:27.983546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a696c-bde2-4575-9a0b-8acb941e4ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:27.984965 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a696c-bde2-4575-9a0b-8acb941e4ae6 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:27.989811 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 280/553] 10.222.0.86 () {56 vars in 1133 bytes} [Fri Jul 15 16:25:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:27.990619 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81627653-00b0-46ce-9b7a-4c96378570c4 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-404a696c-bde2-4575-9a0b-8acb941e4ae6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:25:27.999845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:28.000994 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:28.002448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:28.002448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:28.002448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:25:28.002448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:25:28.002448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:25:28.002448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:25:28.002448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:25:28.002448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:25:28.002448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 16:25:28.002448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:28.002448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 274/554] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:28.002448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a696c-bde2-4575-9a0b-8acb941e4ae6 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:28.024150 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:28.087080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:28.094111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81627653-00b0-46ce-9b7a-4c96378570c4 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:28.102206 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a696c-bde2-4575-9a0b-8acb941e4ae6 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:28.127728 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b242dc-e169-49fa-a4f9-b55c096baee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:28.128386 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b242dc-e169-49fa-a4f9-b55c096baee1 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:28.128677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b242dc-e169-49fa-a4f9-b55c096baee1 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:28.128957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b242dc-e169-49fa-a4f9-b55c096baee1 None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:28.129678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b242dc-e169-49fa-a4f9-b55c096baee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:28.129987 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b242dc-e169-49fa-a4f9-b55c096baee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:28.131407 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b242dc-e169-49fa-a4f9-b55c096baee1 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:28.135175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bc542-6a5a-4ff2-a938-514a64f4072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:28.135836 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bc542-6a5a-4ff2-a938-514a64f4072c None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:28.136123 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bc542-6a5a-4ff2-a938-514a64f4072c None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:28.136404 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bc542-6a5a-4ff2-a938-514a64f4072c None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:28.137148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bc542-6a5a-4ff2-a938-514a64f4072c None admin] RBAC: Adding query filter params (name=service) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:28.137465 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bc542-6a5a-4ff2-a938-514a64f4072c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:28.139516 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bc542-6a5a-4ff2-a938-514a64f4072c None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:28.143252 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 281/555] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:28.144048 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b242dc-e169-49fa-a4f9-b55c096baee1 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:28.150902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 275/556] 10.222.0.86 () {56 vars in 1103 bytes} [Fri Jul 15 16:25:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:28.150902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bc542-6a5a-4ff2-a938-514a64f4072c None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:28.227289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:28.245520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bc542-6a5a-4ff2-a938-514a64f4072c None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:28.245767 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b242dc-e169-49fa-a4f9-b55c096baee1 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:28.279291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a720fc-235b-4d78-9aa4-3ef95259c43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:28.280003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a720fc-235b-4d78-9aa4-3ef95259c43d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:28.280253 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11413f7d-6c90-4ef5-8684-5b80805a84f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:28.280381 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a720fc-235b-4d78-9aa4-3ef95259c43d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:28.280543 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a720fc-235b-4d78-9aa4-3ef95259c43d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:28.280949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11413f7d-6c90-4ef5-8684-5b80805a84f0 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:28.281270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11413f7d-6c90-4ef5-8684-5b80805a84f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:28.281548 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11413f7d-6c90-4ef5-8684-5b80805a84f0 None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:28.282379 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11413f7d-6c90-4ef5-8684-5b80805a84f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:28.282692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11413f7d-6c90-4ef5-8684-5b80805a84f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:28.284157 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11413f7d-6c90-4ef5-8684-5b80805a84f0 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:28.291523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a720fc-235b-4d78-9aa4-3ef95259c43d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:28.292937 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a720fc-235b-4d78-9aa4-3ef95259c43d None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:28.301389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 276/557] 10.222.0.86 () {56 vars in 1137 bytes} [Fri Jul 15 16:25:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:28.302329 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11413f7d-6c90-4ef5-8684-5b80805a84f0 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:28.311492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-40a720fc-235b-4d78-9aa4-3ef95259c43d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:28.311492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:28.311492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:28.311492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:28.311492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:28.311492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:28.311492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:28.311492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:28.311492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:28.311492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:28.311492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:28.311492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:28.311492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:28.311492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:28.311492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:28.312531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:28.313602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:28.313602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:28.313602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:28.313602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:28.315018 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 282/558] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:28.316013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a720fc-235b-4d78-9aa4-3ef95259c43d None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:28.324746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:28.406505 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11413f7d-6c90-4ef5-8684-5b80805a84f0 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:28.416966 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a720fc-235b-4d78-9aa4-3ef95259c43d None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:28.440826 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304287f9-d1f6-44e8-a6a8-a92e71a469e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:28.441619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304287f9-d1f6-44e8-a6a8-a92e71a469e4 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:28.441900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304287f9-d1f6-44e8-a6a8-a92e71a469e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:28.442176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304287f9-d1f6-44e8-a6a8-a92e71a469e4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:28.449106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304287f9-d1f6-44e8-a6a8-a92e71a469e4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:28.450961 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fe1d5-035a-4826-9e0a-dfaa835a9249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:28.451115 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304287f9-d1f6-44e8-a6a8-a92e71a469e4 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:28.451746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fe1d5-035a-4826-9e0a-dfaa835a9249 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:28.452267 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fe1d5-035a-4826-9e0a-dfaa835a9249 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:28.452438 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fe1d5-035a-4826-9e0a-dfaa835a9249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:28.453586 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:28.462831 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fe1d5-035a-4826-9e0a-dfaa835a9249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:28.464299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fe1d5-035a-4826-9e0a-dfaa835a9249 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-304287f9-d1f6-44e8-a6a8-a92e71a469e4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:25:28.467134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:28.468230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:28.469387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:28.469387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:28.469387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:25:28.469387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:25:28.469387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:25:28.469387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:25:28.469387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:25:28.469387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:25:28.469387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 16:25:28.469387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:28.469387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 277/559] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:28.469387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304287f9-d1f6-44e8-a6a8-a92e71a469e4 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:28.484863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-b69fe1d5-035a-4826-9e0a-dfaa835a9249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:28.484863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:28.484863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:28.484863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:28.484863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:28.484863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:28.484863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:28.484863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:28.484863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:28.484863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:28.484863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:28.484863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:28.484863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:28.484863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:28.484863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:28.486031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:28.486969 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:28.486969 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:28.486969 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:28.486969 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:28.486969 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 283/560] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:28.486969 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fe1d5-035a-4826-9e0a-dfaa835a9249 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:28.546086 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:28.569491 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304287f9-d1f6-44e8-a6a8-a92e71a469e4 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:28.587269 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fe1d5-035a-4826-9e0a-dfaa835a9249 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:28.603687 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99f695-3e4c-4dee-bf76-298bae3ce847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:28.604484 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99f695-3e4c-4dee-bf76-298bae3ce847 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:28.604771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99f695-3e4c-4dee-bf76-298bae3ce847 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:28.605059 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99f695-3e4c-4dee-bf76-298bae3ce847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:28.615342 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99f695-3e4c-4dee-bf76-298bae3ce847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:28.616828 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99f695-3e4c-4dee-bf76-298bae3ce847 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:28.622724 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a3a11-d435-4077-95c0-b0a342431ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:28.623456 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a3a11-d435-4077-95c0-b0a342431ec9 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:28.623746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a3a11-d435-4077-95c0-b0a342431ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:28.624025 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a3a11-d435-4077-95c0-b0a342431ec9 None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:28.624739 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a3a11-d435-4077-95c0-b0a342431ec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:28.625043 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a3a11-d435-4077-95c0-b0a342431ec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:28.626372 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a3a11-d435-4077-95c0-b0a342431ec9 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:28.634643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-0d99f695-3e4c-4dee-bf76-298bae3ce847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:28.634643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:28.634643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:28.634643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:28.634643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:28.634643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:28.634643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:28.634643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:28.634643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:28.634643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:28.634643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:28.634643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:28.634643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:28.634643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:28.634643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:28.635758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:28.636935 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:28.636935 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:28.636935 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:28.636935 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:28.636935 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 278/561] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:28.636935 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99f695-3e4c-4dee-bf76-298bae3ce847 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:28.641948 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 284/562] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:28.642811 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a3a11-d435-4077-95c0-b0a342431ec9 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:28.694152 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:28.739117 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a3a11-d435-4077-95c0-b0a342431ec9 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:28.740984 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99f695-3e4c-4dee-bf76-298bae3ce847 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:28.757303 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:28.775368 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0892d-9ed5-4bdf-a197-5b4c6d60a5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:28.776019 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0892d-9ed5-4bdf-a197-5b4c6d60a5af None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:28.776134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb9eb9-e7d6-465a-8fe2-6269e9d855c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:28.776302 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0892d-9ed5-4bdf-a197-5b4c6d60a5af None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:28.776576 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0892d-9ed5-4bdf-a197-5b4c6d60a5af None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:28.777037 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb9eb9-e7d6-465a-8fe2-6269e9d855c6 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:28.777303 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0892d-9ed5-4bdf-a197-5b4c6d60a5af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:28.777520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb9eb9-e7d6-465a-8fe2-6269e9d855c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:28.777611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0892d-9ed5-4bdf-a197-5b4c6d60a5af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:28.777960 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb9eb9-e7d6-465a-8fe2-6269e9d855c6 None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:28.778952 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb9eb9-e7d6-465a-8fe2-6269e9d855c6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:28.779047 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0892d-9ed5-4bdf-a197-5b4c6d60a5af None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:28.779443 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb9eb9-e7d6-465a-8fe2-6269e9d855c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:28.780965 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb9eb9-e7d6-465a-8fe2-6269e9d855c6 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:28.789972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 285/563] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:28.790759 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0892d-9ed5-4bdf-a197-5b4c6d60a5af None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:28.807379 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 279/564] 10.222.0.86 () {56 vars in 1137 bytes} [Fri Jul 15 16:25:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:28.807379 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb9eb9-e7d6-465a-8fe2-6269e9d855c6 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:28.890497 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0892d-9ed5-4bdf-a197-5b4c6d60a5af None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:28.908253 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb9eb9-e7d6-465a-8fe2-6269e9d855c6 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:28.918548 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:28.923171 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979bfd1-aca9-41ff-8b26-aba5f3afa17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:28.923825 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979bfd1-aca9-41ff-8b26-aba5f3afa17b None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:28.924103 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979bfd1-aca9-41ff-8b26-aba5f3afa17b None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:28.924377 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979bfd1-aca9-41ff-8b26-aba5f3afa17b None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:28.925092 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979bfd1-aca9-41ff-8b26-aba5f3afa17b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:28.925397 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979bfd1-aca9-41ff-8b26-aba5f3afa17b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:28.926756 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979bfd1-aca9-41ff-8b26-aba5f3afa17b None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:28.938690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 286/565] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:28.939514 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979bfd1-aca9-41ff-8b26-aba5f3afa17b None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:28.942261 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98906e-fd7c-41d7-8ff7-11cae1f73f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:28.943084 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98906e-fd7c-41d7-8ff7-11cae1f73f96 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:28.943371 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98906e-fd7c-41d7-8ff7-11cae1f73f96 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:28.943645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98906e-fd7c-41d7-8ff7-11cae1f73f96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:28.951300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98906e-fd7c-41d7-8ff7-11cae1f73f96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:28.952753 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98906e-fd7c-41d7-8ff7-11cae1f73f96 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:28.966630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-3f98906e-fd7c-41d7-8ff7-11cae1f73f96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:28.966630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:28.966630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:28.966630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:28.966630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:28.966630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:28.966630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:28.966630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:28.966630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:28.966630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:28.966630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:28.966630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:28.966630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:25:28.966630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:25:28.966630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:28.967661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:28.968531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:25:28.968531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:25:28.968531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:25:28.968531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:25:28.968531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:25:28.968531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:25:28.968531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:28.968531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:28.968531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 280/566] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:28.969304 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98906e-fd7c-41d7-8ff7-11cae1f73f96 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:28.984956 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:29.045684 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979bfd1-aca9-41ff-8b26-aba5f3afa17b None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:29.067264 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98906e-fd7c-41d7-8ff7-11cae1f73f96 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:29.079105 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b7b16-564c-460c-8147-de45fcaac20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:29.079888 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b7b16-564c-460c-8147-de45fcaac20f None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:29.080170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b7b16-564c-460c-8147-de45fcaac20f None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:29.080447 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b7b16-564c-460c-8147-de45fcaac20f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:29.087351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b7b16-564c-460c-8147-de45fcaac20f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:29.088773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b7b16-564c-460c-8147-de45fcaac20f None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:29.100274 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85e495-cb19-4f06-a5a1-e47a1e625b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:29.101049 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85e495-cb19-4f06-a5a1-e47a1e625b29 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:29.101331 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85e495-cb19-4f06-a5a1-e47a1e625b29 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:29.101604 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85e495-cb19-4f06-a5a1-e47a1e625b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-583b7b16-564c-460c-8147-de45fcaac20f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:25:29.103161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:29.104084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:29.105006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:29.105006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:29.105006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:25:29.105006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:25:29.105006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:25:29.105006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:25:29.105006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:25:29.105006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:25:29.105006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 16:25:29.105006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:29.105006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 287/567] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:25:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:29.105574 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b7b16-564c-460c-8147-de45fcaac20f None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:29.117553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85e495-cb19-4f06-a5a1-e47a1e625b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:29.119025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85e495-cb19-4f06-a5a1-e47a1e625b29 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:29.136399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-cc85e495-cb19-4f06-a5a1-e47a1e625b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:29.136399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:29.136399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:29.136399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:29.136399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:29.136399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:29.136399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:29.136399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:29.136399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:29.136399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:29.136399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:29.136399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:29.136399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:29.136399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:29.136399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:29.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:29.138767 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:29.138767 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:29.138767 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:29.138767 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:29.138767 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 281/568] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:29.139299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85e495-cb19-4f06-a5a1-e47a1e625b29 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:29.163164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:29.203041 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:29.207052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b7b16-564c-460c-8147-de45fcaac20f None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:29.237888 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85e495-cb19-4f06-a5a1-e47a1e625b29 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:29.240669 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d1cb7-8f9e-4c4b-bfa2-a734f8fcfd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:29.241443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d1cb7-8f9e-4c4b-bfa2-a734f8fcfd32 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:29.241724 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d1cb7-8f9e-4c4b-bfa2-a734f8fcfd32 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:29.241999 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d1cb7-8f9e-4c4b-bfa2-a734f8fcfd32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:29.248527 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d1cb7-8f9e-4c4b-bfa2-a734f8fcfd32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:29.249957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d1cb7-8f9e-4c4b-bfa2-a734f8fcfd32 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:29.263838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-eb9d1cb7-8f9e-4c4b-bfa2-a734f8fcfd32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:29.263838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:29.263838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:29.263838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:29.263838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:29.263838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:29.263838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:29.263838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:29.263838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:29.263838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:29.263838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:29.263838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:29.263838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:25:29.263838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:25:29.263838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:29.264777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:29.265665 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:25:29.265665 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:25:29.265665 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:25:29.265665 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:25:29.265665 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:25:29.265665 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:25:29.265665 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:29.265665 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:29.265665 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 288/569] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:29.266243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d1cb7-8f9e-4c4b-bfa2-a734f8fcfd32 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:29.275177 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dfe55-966a-4939-ba91-76b4c4fc1238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:29.275845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dfe55-966a-4939-ba91-76b4c4fc1238 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:29.276133 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dfe55-966a-4939-ba91-76b4c4fc1238 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:29.276413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dfe55-966a-4939-ba91-76b4c4fc1238 None admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:29.277194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dfe55-966a-4939-ba91-76b4c4fc1238 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:29.277510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dfe55-966a-4939-ba91-76b4c4fc1238 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:29.279512 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dfe55-966a-4939-ba91-76b4c4fc1238 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:29.291336 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 282/570] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:25:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:29.292124 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dfe55-966a-4939-ba91-76b4c4fc1238 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:29.370709 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d1cb7-8f9e-4c4b-bfa2-a734f8fcfd32 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:29.372018 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:29.391682 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dfe55-966a-4939-ba91-76b4c4fc1238 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:29.404736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f739fa-a016-4749-a6c3-8474544ca7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:29.405485 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f739fa-a016-4749-a6c3-8474544ca7cf None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:29.405763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f739fa-a016-4749-a6c3-8474544ca7cf None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:29.406051 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f739fa-a016-4749-a6c3-8474544ca7cf None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:29.406909 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f739fa-a016-4749-a6c3-8474544ca7cf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:29.407226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f739fa-a016-4749-a6c3-8474544ca7cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:29.408654 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f739fa-a016-4749-a6c3-8474544ca7cf None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:29.427551 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8ba9a-92fb-4240-b4b7-fcfc4e2b365d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:29.427742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 289/571] 10.222.0.86 () {56 vars in 1139 bytes} [Fri Jul 15 16:25:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:29.428151 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8ba9a-92fb-4240-b4b7-fcfc4e2b365d None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:29.428151 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8ba9a-92fb-4240-b4b7-fcfc4e2b365d None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:29.428151 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8ba9a-92fb-4240-b4b7-fcfc4e2b365d None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:29.428388 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f739fa-a016-4749-a6c3-8474544ca7cf None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:29.428462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8ba9a-92fb-4240-b4b7-fcfc4e2b365d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:29.428766 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8ba9a-92fb-4240-b4b7-fcfc4e2b365d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:29.430128 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8ba9a-92fb-4240-b4b7-fcfc4e2b365d None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:29.441622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 283/572] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:29.442397 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8ba9a-92fb-4240-b4b7-fcfc4e2b365d None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:29.452675 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:29.534835 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f739fa-a016-4749-a6c3-8474544ca7cf None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:29.542547 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8ba9a-92fb-4240-b4b7-fcfc4e2b365d None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:29.568417 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113c2d9-5645-4b4b-b2b6-6c2b5c49c0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:29.569060 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113c2d9-5645-4b4b-b2b6-6c2b5c49c0d8 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:29.569341 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113c2d9-5645-4b4b-b2b6-6c2b5c49c0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:29.569613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113c2d9-5645-4b4b-b2b6-6c2b5c49c0d8 None admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:29.570383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113c2d9-5645-4b4b-b2b6-6c2b5c49c0d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:29.570689 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113c2d9-5645-4b4b-b2b6-6c2b5c49c0d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:29.572136 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113c2d9-5645-4b4b-b2b6-6c2b5c49c0d8 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:29.575758 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdd7b2-4264-4888-90fe-f1e047db76ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:29.576645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdd7b2-4264-4888-90fe-f1e047db76ca None admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:29.576928 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdd7b2-4264-4888-90fe-f1e047db76ca None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:29.577203 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdd7b2-4264-4888-90fe-f1e047db76ca None admin] PATH_INFO: `/v3/projects/db599cc43051468cbf306faba2431b23/users/f34916bd4d56411e8994d1c476885e2e/roles/0d630eb5fff7436391281167da032c15` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:29.583704 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 290/573] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:25:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:29.584492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113c2d9-5645-4b4b-b2b6-6c2b5c49c0d8 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:29.590680 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:29.594307 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffdd7b2-4264-4888-90fe-f1e047db76ca None admin] RBAC: Authorizing `identity:create_grant(project_id=db599cc43051468cbf306faba2431b23, user_id=f34916bd4d56411e8994d1c476885e2e, role_id=0d630eb5fff7436391281167da032c15)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:29.596095 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffdd7b2-4264-4888-90fe-f1e047db76ca None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:29.608795 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 284/574] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:25:29 2022] PUT /identity/v3/projects/db599cc43051468cbf306faba2431b23/users/f34916bd4d56411e8994d1c476885e2e/roles/0d630eb5fff7436391281167da032c15 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:25:29.609576 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdd7b2-4264-4888-90fe-f1e047db76ca None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:29.680969 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:29.708710 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113c2d9-5645-4b4b-b2b6-6c2b5c49c0d8 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:29.725843 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdd7b2-4264-4888-90fe-f1e047db76ca None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:29.746250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf709375-3b6f-40ee-9b33-cbd017b9110f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:29.747077 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf709375-3b6f-40ee-9b33-cbd017b9110f None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:29.747426 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf709375-3b6f-40ee-9b33-cbd017b9110f None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:29.747703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf709375-3b6f-40ee-9b33-cbd017b9110f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:29.760396 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf709375-3b6f-40ee-9b33-cbd017b9110f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:29.762237 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf709375-3b6f-40ee-9b33-cbd017b9110f None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:29.764467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a9c4f-0da0-48cf-8f5d-eecfa5154e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:29.765291 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a9c4f-0da0-48cf-8f5d-eecfa5154e01 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:29.765576 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a9c4f-0da0-48cf-8f5d-eecfa5154e01 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:29.765856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a9c4f-0da0-48cf-8f5d-eecfa5154e01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:29.774324 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a9c4f-0da0-48cf-8f5d-eecfa5154e01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:29.776563 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a9c4f-0da0-48cf-8f5d-eecfa5154e01 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:29.783191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-cf709375-3b6f-40ee-9b33-cbd017b9110f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:29.783191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:29.783191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:29.783191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:29.783191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:29.783191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:29.783191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:29.783191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:29.783191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:29.783191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:29.783191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:29.783191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:29.783191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:29.783191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:29.783191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:29.784070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:29.785365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:29.785365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:29.785365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:29.785365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:29.785365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 291/575] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:29.785896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf709375-3b6f-40ee-9b33-cbd017b9110f None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:29.795463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-c78a9c4f-0da0-48cf-8f5d-eecfa5154e01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:29.795463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:29.795463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:29.795463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:29.795463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:29.795463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:29.795463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:29.795463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:29.795463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:29.795463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:29.795463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:29.795463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:29.795463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:25:29.795463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:25:29.795463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:29.796365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:29.797226 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:25:29.797226 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:25:29.797226 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:25:29.797226 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:25:29.797226 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:25:29.797226 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:25:29.797226 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:29.797226 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:29.797226 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 285/576] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:29.798984 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a9c4f-0da0-48cf-8f5d-eecfa5154e01 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:29.868307 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:29.896338 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf709375-3b6f-40ee-9b33-cbd017b9110f None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:29.922388 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a9c4f-0da0-48cf-8f5d-eecfa5154e01 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:29.923872 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:29.932205 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27f8b5-ad10-45df-b9ea-6f63f30bdb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:29.933017 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f8b5-ad10-45df-b9ea-6f63f30bdb19 None admin] REQUEST_METHOD: `PUT` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:29.933302 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f8b5-ad10-45df-b9ea-6f63f30bdb19 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:29.933574 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f8b5-ad10-45df-b9ea-6f63f30bdb19 None admin] PATH_INFO: `/v3/projects/db599cc43051468cbf306faba2431b23/users/2a518605222244f2974ab19a03e4cf93/roles/0d630eb5fff7436391281167da032c15` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:29.948867 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27f8b5-ad10-45df-b9ea-6f63f30bdb19 None admin] RBAC: Authorizing `identity:create_grant(project_id=db599cc43051468cbf306faba2431b23, user_id=2a518605222244f2974ab19a03e4cf93, role_id=0d630eb5fff7436391281167da032c15)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:29.950339 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27f8b5-ad10-45df-b9ea-6f63f30bdb19 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:29.961387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1693ff-25f2-46ae-8c14-11444e483147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:29.962315 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1693ff-25f2-46ae-8c14-11444e483147 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:29.962796 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1693ff-25f2-46ae-8c14-11444e483147 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:29.963287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1693ff-25f2-46ae-8c14-11444e483147 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:29.963806 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 292/577] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:25:29 2022] PUT /identity/v3/projects/db599cc43051468cbf306faba2431b23/users/2a518605222244f2974ab19a03e4cf93/roles/0d630eb5fff7436391281167da032c15 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:25:29.964448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1693ff-25f2-46ae-8c14-11444e483147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:29.964620 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27f8b5-ad10-45df-b9ea-6f63f30bdb19 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:29.965100 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1693ff-25f2-46ae-8c14-11444e483147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:29.966538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1693ff-25f2-46ae-8c14-11444e483147 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:29.981360 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 286/578] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:29.987969 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1693ff-25f2-46ae-8c14-11444e483147 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:30.093606 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27f8b5-ad10-45df-b9ea-6f63f30bdb19 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:30.107912 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1693ff-25f2-46ae-8c14-11444e483147 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:30.123771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:30.144434 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ceb879-815c-4160-bca1-642b96baacb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:30.145113 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceb879-815c-4160-bca1-642b96baacb2 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:30.145397 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceb879-815c-4160-bca1-642b96baacb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:30.145672 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceb879-815c-4160-bca1-642b96baacb2 None admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:30.146481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ceb879-815c-4160-bca1-642b96baacb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:30.146796 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ceb879-815c-4160-bca1-642b96baacb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:30.148268 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ceb879-815c-4160-bca1-642b96baacb2 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:30.161691 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec90068-8b0c-4513-9f4c-f97244ead93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:30.162977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec90068-8b0c-4513-9f4c-f97244ead93c None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:30.163472 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec90068-8b0c-4513-9f4c-f97244ead93c None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:30.163992 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec90068-8b0c-4513-9f4c-f97244ead93c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:30.167124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 293/579] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:25:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:30.168076 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ceb879-815c-4160-bca1-642b96baacb2 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:30.174710 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec90068-8b0c-4513-9f4c-f97244ead93c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:30.176205 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec90068-8b0c-4513-9f4c-f97244ead93c None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:30.193066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-2ec90068-8b0c-4513-9f4c-f97244ead93c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:30.193066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:30.193066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:30.193066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:30.193066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:30.193066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:30.193066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:30.193066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:30.193066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:30.193066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:30.193066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:30.193066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:30.193066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:25:30.193066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:25:30.193066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:30.194199 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:30.195302 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:25:30.195302 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:25:30.195302 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:25:30.195302 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:25:30.195302 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:25:30.195302 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:25:30.195302 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:30.195302 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:30.195302 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 287/580] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:30.200306 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec90068-8b0c-4513-9f4c-f97244ead93c None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:30.217635 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:30.297912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ceb879-815c-4160-bca1-642b96baacb2 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:30.323929 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec90068-8b0c-4513-9f4c-f97244ead93c None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:30.333189 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae854a-baf6-4762-9f57-75b5ed1798d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:30.334086 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae854a-baf6-4762-9f57-75b5ed1798d0 None admin] REQUEST_METHOD: `PUT` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:30.334372 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae854a-baf6-4762-9f57-75b5ed1798d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:30.334651 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae854a-baf6-4762-9f57-75b5ed1798d0 None admin] PATH_INFO: `/v3/projects/db599cc43051468cbf306faba2431b23/users/a101281ae1f2474886c1ec214f042d24/roles/0d630eb5fff7436391281167da032c15` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:30.350763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae854a-baf6-4762-9f57-75b5ed1798d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=db599cc43051468cbf306faba2431b23, user_id=a101281ae1f2474886c1ec214f042d24, role_id=0d630eb5fff7436391281167da032c15)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:30.352241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae854a-baf6-4762-9f57-75b5ed1798d0 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:30.362065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5f998-59d2-4519-9dfa-ce8b512d381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:30.362738 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5f998-59d2-4519-9dfa-ce8b512d381a None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:30.363060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5f998-59d2-4519-9dfa-ce8b512d381a None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:30.363339 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5f998-59d2-4519-9dfa-ce8b512d381a None admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:30.364132 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5f998-59d2-4519-9dfa-ce8b512d381a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:30.364443 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5f998-59d2-4519-9dfa-ce8b512d381a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:30.365887 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5f998-59d2-4519-9dfa-ce8b512d381a None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:30.368945 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 294/581] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:25:30 2022] PUT /identity/v3/projects/db599cc43051468cbf306faba2431b23/users/a101281ae1f2474886c1ec214f042d24/roles/0d630eb5fff7436391281167da032c15 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:25:30.381919 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 288/582] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:30.387555 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae854a-baf6-4762-9f57-75b5ed1798d0 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:30.500939 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:30.515794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae854a-baf6-4762-9f57-75b5ed1798d0 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:30.557462 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa12e8a-fa5c-4bcf-9bb8-3cea0d95dc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:30.558356 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa12e8a-fa5c-4bcf-9bb8-3cea0d95dc4b None admin] REQUEST_METHOD: `PUT` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:30.558682 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa12e8a-fa5c-4bcf-9bb8-3cea0d95dc4b None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:30.559002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa12e8a-fa5c-4bcf-9bb8-3cea0d95dc4b None admin] PATH_INFO: `/v3/projects/db599cc43051468cbf306faba2431b23/users/8e620f2a895241279b63327d6a7d3dae/roles/0d630eb5fff7436391281167da032c15` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:30.577346 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa12e8a-fa5c-4bcf-9bb8-3cea0d95dc4b None admin] RBAC: Authorizing `identity:create_grant(project_id=db599cc43051468cbf306faba2431b23, user_id=8e620f2a895241279b63327d6a7d3dae, role_id=0d630eb5fff7436391281167da032c15)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:30.579158 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa12e8a-fa5c-4bcf-9bb8-3cea0d95dc4b None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:30.596102 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 295/583] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:25:30 2022] PUT /identity/v3/projects/db599cc43051468cbf306faba2431b23/users/8e620f2a895241279b63327d6a7d3dae/roles/0d630eb5fff7436391281167da032c15 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:25:31.923556 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb05c43-695f-4592-8784-841a8b8d0fa4 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:31.924121 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb05c43-695f-4592-8784-841a8b8d0fa4 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:31.924121 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb05c43-695f-4592-8784-841a8b8d0fa4 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:31.925728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 289/584] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:31.931008 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e3a8d-2aae-437d-ae70-1208fd6d8d92 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:31.931435 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e3a8d-2aae-437d-ae70-1208fd6d8d92 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:31.931636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e3a8d-2aae-437d-ae70-1208fd6d8d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:31.949393 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-8c6e3a8d-2aae-437d-ae70-1208fd6d8d92 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:31.951273 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-8c6e3a8d-2aae-437d-ae70-1208fd6d8d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:32.023545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 296/585] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:32.048186 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb05c43-695f-4592-8784-841a8b8d0fa4 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:32.088189 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:32.169771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb05c43-695f-4592-8784-841a8b8d0fa4 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:32.208187 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f6e90-85a6-4bd7-a420-fddec3ae7fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:32.209009 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f6e90-85a6-4bd7-a420-fddec3ae7fdb None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:32.209297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f6e90-85a6-4bd7-a420-fddec3ae7fdb None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:32.209576 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f6e90-85a6-4bd7-a420-fddec3ae7fdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:32.222393 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f6e90-85a6-4bd7-a420-fddec3ae7fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-5c4f6e90-85a6-4bd7-a420-fddec3ae7fdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:32.230462 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:32.232119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:32.233016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:32.233016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:32.233016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:32.233016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:32.233016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:32.233016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:32.233016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:32.233016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:32.233016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:32.233016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:32.233016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:32.233016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:32.233016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 290/586] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:25:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:32.238259 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e3a8d-2aae-437d-ae70-1208fd6d8d92 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:32.305810 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:32.345657 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e3a8d-2aae-437d-ae70-1208fd6d8d92 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:32.382306 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83b5e3-74a0-4bf8-a1be-545b6d71c3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:32.383130 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83b5e3-74a0-4bf8-a1be-545b6d71c3f3 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:32.383498 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83b5e3-74a0-4bf8-a1be-545b6d71c3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:32.383855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83b5e3-74a0-4bf8-a1be-545b6d71c3f3 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:32.384690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83b5e3-74a0-4bf8-a1be-545b6d71c3f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:32.385078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83b5e3-74a0-4bf8-a1be-545b6d71c3f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:32.386530 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83b5e3-74a0-4bf8-a1be-545b6d71c3f3 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:32.395714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 297/587] 10.222.0.86 () {56 vars in 1103 bytes} [Fri Jul 15 16:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:32.401182 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f6e90-85a6-4bd7-a420-fddec3ae7fdb None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:32.406805 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b44e1e-61e0-4b72-90a4-2f9272478625 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:32.406805 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b44e1e-61e0-4b72-90a4-2f9272478625 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:32.406805 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b44e1e-61e0-4b72-90a4-2f9272478625 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:32.406805 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 298/588] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:32.412110 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5465fe-9d3f-4930-961a-afbe45ab3bbf None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:32.412570 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5465fe-9d3f-4930-961a-afbe45ab3bbf None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:32.413022 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5465fe-9d3f-4930-961a-afbe45ab3bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:32.430158 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-3a5465fe-9d3f-4930-961a-afbe45ab3bbf None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:32.431314 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-3a5465fe-9d3f-4930-961a-afbe45ab3bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:32.514737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 299/589] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:25:32.526729 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:32.537185 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f6e90-85a6-4bd7-a420-fddec3ae7fdb None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:32.539669 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5465fe-9d3f-4930-961a-afbe45ab3bbf None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:32.574252 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884d420-324e-413f-94a8-c70e6a46254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:32.575167 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884d420-324e-413f-94a8-c70e6a46254f None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:32.575722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884d420-324e-413f-94a8-c70e6a46254f None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:32.575989 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884d420-324e-413f-94a8-c70e6a46254f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:32.588669 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884d420-324e-413f-94a8-c70e6a46254f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:32.591331 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884d420-324e-413f-94a8-c70e6a46254f None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:32.613934 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:32.619900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-3884d420-324e-413f-94a8-c70e6a46254f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:32.619900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:32.619900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:32.619900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:32.619900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:32.619900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:32.619900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:32.619900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:32.619900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:32.619900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:32.619900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:32.619900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:32.619900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:32.619900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:32.619900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:32.621057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:32.622205 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:32.622205 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:32.622205 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:32.622205 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:32.622205 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 291/590] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:32.629814 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884d420-324e-413f-94a8-c70e6a46254f None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:32.664842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5465fe-9d3f-4930-961a-afbe45ab3bbf None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:32.701915 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45868ad5-38f6-4009-ae3f-c4a47125b24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:32.702731 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45868ad5-38f6-4009-ae3f-c4a47125b24d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:32.703117 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45868ad5-38f6-4009-ae3f-c4a47125b24d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:32.703459 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45868ad5-38f6-4009-ae3f-c4a47125b24d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:32.714297 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45868ad5-38f6-4009-ae3f-c4a47125b24d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-45868ad5-38f6-4009-ae3f-c4a47125b24d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:32.722545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:32.723763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:32.724808 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:32.724808 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:32.724808 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:32.724808 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:32.724808 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:32.724808 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:32.724808 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:32.724808 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:32.724808 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:32.724808 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:32.724808 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:32.724808 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:32.730370 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 300/591] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:25:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:32.731494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45868ad5-38f6-4009-ae3f-c4a47125b24d None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:32.758140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884d420-324e-413f-94a8-c70e6a46254f None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:32.797355 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdd1d4-bee4-4ae8-ae1a-fe7854cd2488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:32.798028 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdd1d4-bee4-4ae8-ae1a-fe7854cd2488 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:32.798312 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdd1d4-bee4-4ae8-ae1a-fe7854cd2488 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:32.798595 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdd1d4-bee4-4ae8-ae1a-fe7854cd2488 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:32.799355 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdd1d4-bee4-4ae8-ae1a-fe7854cd2488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:32.799669 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdd1d4-bee4-4ae8-ae1a-fe7854cd2488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:32.801039 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdd1d4-bee4-4ae8-ae1a-fe7854cd2488 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:32.820075 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 292/592] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:32.820075 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16682aa9-b7af-4d5a-af31-b42a8876ebb2 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:32.820075 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16682aa9-b7af-4d5a-af31-b42a8876ebb2 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:32.820075 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16682aa9-b7af-4d5a-af31-b42a8876ebb2 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:32.820075 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 293/593] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:32.823007 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16682aa9-b7af-4d5a-af31-b42a8876ebb2 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:32.827932 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:32.842406 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45868ad5-38f6-4009-ae3f-c4a47125b24d None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:32.869326 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:32.885589 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d761903-78f9-4248-a5cd-be88969c90fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:32.886345 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d761903-78f9-4248-a5cd-be88969c90fe None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:32.886641 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d761903-78f9-4248-a5cd-be88969c90fe None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:32.886956 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d761903-78f9-4248-a5cd-be88969c90fe None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:32.887741 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d761903-78f9-4248-a5cd-be88969c90fe None admin] RBAC: Adding query filter params (name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:32.888058 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d761903-78f9-4248-a5cd-be88969c90fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:32.889538 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d761903-78f9-4248-a5cd-be88969c90fe None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:32.902762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 301/594] 10.222.0.86 () {56 vars in 1103 bytes} [Fri Jul 15 16:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:32.902762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e74f3-e843-43cd-bb77-5c89ccbaae0a None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:32.902762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e74f3-e843-43cd-bb77-5c89ccbaae0a None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:32.902762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e74f3-e843-43cd-bb77-5c89ccbaae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:32.916760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-e89e74f3-e843-43cd-bb77-5c89ccbaae0a None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:32.917954 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-e89e74f3-e843-43cd-bb77-5c89ccbaae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:32.945557 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16682aa9-b7af-4d5a-af31-b42a8876ebb2 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:32.978783 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619255c-4d51-48f4-96cc-5e5d4eba6b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:32.979531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619255c-4d51-48f4-96cc-5e5d4eba6b57 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:32.979813 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619255c-4d51-48f4-96cc-5e5d4eba6b57 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:32.980087 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619255c-4d51-48f4-96cc-5e5d4eba6b57 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:32.984559 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 302/595] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:32.985406 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e74f3-e843-43cd-bb77-5c89ccbaae0a None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:32.987771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619255c-4d51-48f4-96cc-5e5d4eba6b57 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:32.989201 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619255c-4d51-48f4-96cc-5e5d4eba6b57 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-a619255c-4d51-48f4-96cc-5e5d4eba6b57 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:25:33.004109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:33.005090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:33.006087 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:33.006087 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:33.006087 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:25:33.006087 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:25:33.006087 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:25:33.006087 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:25:33.006087 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:25:33.006087 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:25:33.006087 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 16:25:33.006087 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:33.006087 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 294/596] 10.222.0.86 () {56 vars in 1093 bytes} [Fri Jul 15 16:25:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:33.007756 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a352c11-de86-461d-9455-bd96fab8f05c None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:33.007756 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a352c11-de86-461d-9455-bd96fab8f05c None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:33.007756 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a352c11-de86-461d-9455-bd96fab8f05c None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:33.008628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 295/597] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:33.009314 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a352c11-de86-461d-9455-bd96fab8f05c None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:33.072506 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:33.097936 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e74f3-e843-43cd-bb77-5c89ccbaae0a None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:33.111398 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:33.112106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a352c11-de86-461d-9455-bd96fab8f05c None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:33.134329 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7a949-56af-4868-bf2b-76253c1a182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:33.135207 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7a949-56af-4868-bf2b-76253c1a182b None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:33.135491 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7a949-56af-4868-bf2b-76253c1a182b None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:33.135769 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7a949-56af-4868-bf2b-76253c1a182b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:33.145930 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7a949-56af-4868-bf2b-76253c1a182b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:33.147017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f15ae-5e2d-42ee-b35f-9feff5392ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:33.147407 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7a949-56af-4868-bf2b-76253c1a182b None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:33.147806 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f15ae-5e2d-42ee-b35f-9feff5392ef7 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:33.148095 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f15ae-5e2d-42ee-b35f-9feff5392ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:33.148376 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f15ae-5e2d-42ee-b35f-9feff5392ef7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:33.159011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f15ae-5e2d-42ee-b35f-9feff5392ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:33.165161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-83f7a949-56af-4868-bf2b-76253c1a182b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:33.165161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:33.165161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:33.165161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:33.165161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:33.165161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:33.165161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:33.165161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:33.165161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:33.165161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:33.165161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:33.165161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:33.165161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:33.165161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:33.165161 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:33.166219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:33.167375 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:33.167375 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:33.167375 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:33.167375 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:33.167375 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 303/598] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:33.167715 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7a949-56af-4868-bf2b-76253c1a182b None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-7b3f15ae-5e2d-42ee-b35f-9feff5392ef7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:33.168176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:33.169925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:33.170913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:33.170913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:33.170913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:33.170913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:33.170913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:33.170913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:33.170913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:33.170913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:33.170913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:33.170913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:33.170913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:33.170913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:33.170913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 296/599] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:25:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:33.171654 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026042f-15e8-4d92-bcd1-ad3c938a68bd None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:33.172010 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026042f-15e8-4d92-bcd1-ad3c938a68bd None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:33.172301 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026042f-15e8-4d92-bcd1-ad3c938a68bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:33.190734 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-e026042f-15e8-4d92-bcd1-ad3c938a68bd None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:33.191968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-e026042f-15e8-4d92-bcd1-ad3c938a68bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:33.256739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 297/600] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:33.257482 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026042f-15e8-4d92-bcd1-ad3c938a68bd None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:33.278111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7a949-56af-4868-bf2b-76253c1a182b None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:33.311603 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:33.313956 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19030299-0132-4195-a373-5f280c8c1458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:33.314634 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19030299-0132-4195-a373-5f280c8c1458 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:33.314951 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19030299-0132-4195-a373-5f280c8c1458 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:33.315231 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19030299-0132-4195-a373-5f280c8c1458 None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:33.316056 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19030299-0132-4195-a373-5f280c8c1458 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:33.316365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19030299-0132-4195-a373-5f280c8c1458 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:33.317777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19030299-0132-4195-a373-5f280c8c1458 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:33.335613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 304/601] 10.222.0.86 () {56 vars in 1133 bytes} [Fri Jul 15 16:25:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:33.336401 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19030299-0132-4195-a373-5f280c8c1458 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:33.360116 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026042f-15e8-4d92-bcd1-ad3c938a68bd None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:33.360279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:33.393865 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b72a0-d0b6-4ade-b3c0-be52e8cc567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:33.394524 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b72a0-d0b6-4ade-b3c0-be52e8cc567e None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:33.394804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b72a0-d0b6-4ade-b3c0-be52e8cc567e None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:33.395110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b72a0-d0b6-4ade-b3c0-be52e8cc567e None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:33.395821 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b72a0-d0b6-4ade-b3c0-be52e8cc567e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:33.396125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b72a0-d0b6-4ade-b3c0-be52e8cc567e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:33.397486 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b72a0-d0b6-4ade-b3c0-be52e8cc567e None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:33.408877 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 298/602] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:33.409655 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b72a0-d0b6-4ade-b3c0-be52e8cc567e None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:33.439415 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19030299-0132-4195-a373-5f280c8c1458 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:33.473190 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cfb8d-3b96-4fef-9fd3-fd757093c369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:33.473855 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cfb8d-3b96-4fef-9fd3-fd757093c369 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:33.474146 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cfb8d-3b96-4fef-9fd3-fd757093c369 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:33.474483 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cfb8d-3b96-4fef-9fd3-fd757093c369 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:33.475268 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cfb8d-3b96-4fef-9fd3-fd757093c369 None admin] RBAC: Adding query filter params (name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:33.475580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cfb8d-3b96-4fef-9fd3-fd757093c369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:33.476931 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cfb8d-3b96-4fef-9fd3-fd757093c369 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:33.485570 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 305/603] 10.222.0.86 () {56 vars in 1103 bytes} [Fri Jul 15 16:25:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:33.486204 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cfb8d-3b96-4fef-9fd3-fd757093c369 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:33.518938 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b72a0-d0b6-4ade-b3c0-be52e8cc567e None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:33.533495 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:33.553856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbe913-a331-4cac-86cb-9dc04f8e249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:33.554645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbe913-a331-4cac-86cb-9dc04f8e249d None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:33.554958 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbe913-a331-4cac-86cb-9dc04f8e249d None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:33.555237 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbe913-a331-4cac-86cb-9dc04f8e249d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:33.565016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbe913-a331-4cac-86cb-9dc04f8e249d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:33.569198 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-73cbe913-a331-4cac-86cb-9dc04f8e249d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:33.573166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:33.574114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:33.576113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:33.576113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:33.576113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:33.576113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:33.576113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:33.576113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:33.576113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:33.576113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:33.576113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:33.576113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:33.576113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:25:33.576113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:33.576113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 299/604] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:25:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:33.576113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbe913-a331-4cac-86cb-9dc04f8e249d None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:33.590836 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cfb8d-3b96-4fef-9fd3-fd757093c369 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:33.623927 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214803f4-c6bf-4e80-885c-5b06ed1b4374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:33.624570 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214803f4-c6bf-4e80-885c-5b06ed1b4374 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:33.624856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214803f4-c6bf-4e80-885c-5b06ed1b4374 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:33.625137 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214803f4-c6bf-4e80-885c-5b06ed1b4374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:33.676015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbe913-a331-4cac-86cb-9dc04f8e249d None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:33.690589 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214803f4-c6bf-4e80-885c-5b06ed1b4374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:33.692077 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214803f4-c6bf-4e80-885c-5b06ed1b4374 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:33.709242 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bd94c-b3ee-4d30-a64e-6ba78c215f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:33.710032 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bd94c-b3ee-4d30-a64e-6ba78c215f80 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:33.710316 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bd94c-b3ee-4d30-a64e-6ba78c215f80 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:33.710593 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bd94c-b3ee-4d30-a64e-6ba78c215f80 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:33.718705 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bd94c-b3ee-4d30-a64e-6ba78c215f80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:33.720187 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bd94c-b3ee-4d30-a64e-6ba78c215f80 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-960bd94c-b3ee-4d30-a64e-6ba78c215f80 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:25:33.734613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:33.735784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:33.736974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:33.736974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:33.736974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:25:33.736974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:25:33.736974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:25:33.736974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:25:33.736974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:25:33.736974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:25:33.736974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 16:25:33.736974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:33.739152 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 300/605] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:33.740177 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bd94c-b3ee-4d30-a64e-6ba78c215f80 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:33.774557 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:33.775053 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:33.792502 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 306/606] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:33.793427 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214803f4-c6bf-4e80-885c-5b06ed1b4374 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:33.840284 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bd94c-b3ee-4d30-a64e-6ba78c215f80 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:33.877039 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884d9b7-9499-45b3-a4ba-14907c872329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:33.877836 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884d9b7-9499-45b3-a4ba-14907c872329 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:33.878126 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884d9b7-9499-45b3-a4ba-14907c872329 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:33.878409 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884d9b7-9499-45b3-a4ba-14907c872329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:33.889420 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884d9b7-9499-45b3-a4ba-14907c872329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:33.890856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884d9b7-9499-45b3-a4ba-14907c872329 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:33.892525 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214803f4-c6bf-4e80-885c-5b06ed1b4374 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:33.908191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-8884d9b7-9499-45b3-a4ba-14907c872329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:33.908191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:33.908191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:33.908191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:33.908191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:33.908191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:33.908191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:33.908191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:33.908191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:33.908191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:33.908191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:33.908191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:33.908191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:33.908191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:33.908191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:33.909103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:33.909978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:33.909978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:33.909978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:33.909978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:33.909978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 301/607] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:33.910262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884d9b7-9499-45b3-a4ba-14907c872329 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:33.931420 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82570508-005d-4be6-a1a1-73ae43ba2a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:33.932083 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82570508-005d-4be6-a1a1-73ae43ba2a4c None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:33.932364 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82570508-005d-4be6-a1a1-73ae43ba2a4c None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:33.932636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82570508-005d-4be6-a1a1-73ae43ba2a4c None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:33.933375 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82570508-005d-4be6-a1a1-73ae43ba2a4c None admin] RBAC: Adding query filter params (name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:33.933678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82570508-005d-4be6-a1a1-73ae43ba2a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:33.935196 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82570508-005d-4be6-a1a1-73ae43ba2a4c None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:33.942976 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 307/608] 10.222.0.86 () {56 vars in 1103 bytes} [Fri Jul 15 16:25:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:33.943753 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82570508-005d-4be6-a1a1-73ae43ba2a4c None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:33.991778 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:33.993794 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:34.008690 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884d9b7-9499-45b3-a4ba-14907c872329 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:34.041709 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7df09-a215-4c01-9ff7-2beb9f489f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:34.042586 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7df09-a215-4c01-9ff7-2beb9f489f8b None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:34.042708 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7df09-a215-4c01-9ff7-2beb9f489f8b None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:34.042902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7df09-a215-4c01-9ff7-2beb9f489f8b None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:34.043739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7df09-a215-4c01-9ff7-2beb9f489f8b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:34.044598 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7df09-a215-4c01-9ff7-2beb9f489f8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:34.045745 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82570508-005d-4be6-a1a1-73ae43ba2a4c None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:34.046241 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7df09-a215-4c01-9ff7-2beb9f489f8b None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:34.063790 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 302/609] 10.222.0.86 () {56 vars in 1137 bytes} [Fri Jul 15 16:25:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:34.064597 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7df09-a215-4c01-9ff7-2beb9f489f8b None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:34.083308 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf412cf-c5f9-4507-9606-7a2c0cc7cb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:34.084090 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf412cf-c5f9-4507-9606-7a2c0cc7cb7f None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:34.084371 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf412cf-c5f9-4507-9606-7a2c0cc7cb7f None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:34.084641 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf412cf-c5f9-4507-9606-7a2c0cc7cb7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:34.095137 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf412cf-c5f9-4507-9606-7a2c0cc7cb7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:34.096551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf412cf-c5f9-4507-9606-7a2c0cc7cb7f None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:34.113294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-eaf412cf-c5f9-4507-9606-7a2c0cc7cb7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:34.113294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:34.113294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:34.113294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:34.113294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:34.113294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:34.113294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:34.113294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:34.113294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:34.113294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:34.113294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:34.113294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:34.113294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:34.113294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:34.113294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:34.114363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:34.115339 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:34.115339 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:34.115339 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:34.115339 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:34.115339 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 308/610] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:34.115646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf412cf-c5f9-4507-9606-7a2c0cc7cb7f None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:34.163560 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7df09-a215-4c01-9ff7-2beb9f489f8b None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:34.197067 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac8eab-9bd3-41ed-9e39-1e9f63150d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:34.197721 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac8eab-9bd3-41ed-9e39-1e9f63150d12 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:34.198006 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac8eab-9bd3-41ed-9e39-1e9f63150d12 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:34.198274 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac8eab-9bd3-41ed-9e39-1e9f63150d12 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:34.199022 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac8eab-9bd3-41ed-9e39-1e9f63150d12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:34.199333 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac8eab-9bd3-41ed-9e39-1e9f63150d12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:34.201334 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac8eab-9bd3-41ed-9e39-1e9f63150d12 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:34.212563 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 303/611] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:34.213342 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac8eab-9bd3-41ed-9e39-1e9f63150d12 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:34.216599 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf412cf-c5f9-4507-9606-7a2c0cc7cb7f None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:34.218333 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:34.220182 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:34.252789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22928b-8c48-467e-925d-3c8ad200248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:34.253572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22928b-8c48-467e-925d-3c8ad200248f None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:34.253861 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22928b-8c48-467e-925d-3c8ad200248f None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:34.254142 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22928b-8c48-467e-925d-3c8ad200248f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:34.265163 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22928b-8c48-467e-925d-3c8ad200248f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:34.266610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22928b-8c48-467e-925d-3c8ad200248f None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:34.283627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-ac22928b-8c48-467e-925d-3c8ad200248f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:34.283627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:34.283627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:34.283627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:34.283627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:34.283627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:34.283627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:34.283627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:34.283627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:34.283627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:34.283627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:34.283627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:34.283627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:34.283627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:34.283627 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:34.284677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:34.285560 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:34.285560 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:34.285560 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:34.285560 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:34.285560 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 309/612] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:34.285560 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22928b-8c48-467e-925d-3c8ad200248f None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:34.319209 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac8eab-9bd3-41ed-9e39-1e9f63150d12 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:34.353509 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5b866-32a5-4fb4-adeb-b68a8bae25fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:34.354156 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5b866-32a5-4fb4-adeb-b68a8bae25fb None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:34.354481 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5b866-32a5-4fb4-adeb-b68a8bae25fb None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:34.354770 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5b866-32a5-4fb4-adeb-b68a8bae25fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:34.384824 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22928b-8c48-467e-925d-3c8ad200248f None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:34.418576 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdbe11-ee26-4ba0-93ff-09436b211305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:34.419286 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdbe11-ee26-4ba0-93ff-09436b211305 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:34.419578 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdbe11-ee26-4ba0-93ff-09436b211305 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:34.419865 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdbe11-ee26-4ba0-93ff-09436b211305 None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:34.420586 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdbe11-ee26-4ba0-93ff-09436b211305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:34.420903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdbe11-ee26-4ba0-93ff-09436b211305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:34.421391 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5b866-32a5-4fb4-adeb-b68a8bae25fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:34.422275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdbe11-ee26-4ba0-93ff-09436b211305 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:34.422823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5b866-32a5-4fb4-adeb-b68a8bae25fb None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:34.425423 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:34.436175 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 310/613] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:34.436995 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdbe11-ee26-4ba0-93ff-09436b211305 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:34.448451 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:34.527508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 304/614] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:34.528393 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5b866-32a5-4fb4-adeb-b68a8bae25fb None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:34.538732 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdbe11-ee26-4ba0-93ff-09436b211305 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:34.572350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394011d0-d390-4984-87ef-120cbccd826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:34.573073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394011d0-d390-4984-87ef-120cbccd826d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:34.573358 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394011d0-d390-4984-87ef-120cbccd826d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:34.573638 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394011d0-d390-4984-87ef-120cbccd826d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:34.581354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394011d0-d390-4984-87ef-120cbccd826d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:34.582799 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394011d0-d390-4984-87ef-120cbccd826d None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-394011d0-d390-4984-87ef-120cbccd826d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:25:34.597668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:34.598802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:34.599800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:34.599800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:34.599800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:25:34.599800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:25:34.599800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:25:34.599800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:25:34.599800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:25:34.599800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:25:34.599800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 16:25:34.599800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:34.599800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 311/615] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:34.599800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394011d0-d390-4984-87ef-120cbccd826d None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:34.627519 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5b866-32a5-4fb4-adeb-b68a8bae25fb None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:34.630641 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:34.664371 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5e327-b891-4e6a-b63b-afd06aabf449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:34.665031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5e327-b891-4e6a-b63b-afd06aabf449 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:34.665313 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5e327-b891-4e6a-b63b-afd06aabf449 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:34.665595 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5e327-b891-4e6a-b63b-afd06aabf449 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:34.666308 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5e327-b891-4e6a-b63b-afd06aabf449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:34.666620 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5e327-b891-4e6a-b63b-afd06aabf449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:34.668021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5e327-b891-4e6a-b63b-afd06aabf449 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:34.668840 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:34.679274 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 305/616] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:34.680076 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5e327-b891-4e6a-b63b-afd06aabf449 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:34.705799 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394011d0-d390-4984-87ef-120cbccd826d None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:34.739036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26e1df-3b24-4420-b48e-191b586b0076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:34.740025 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26e1df-3b24-4420-b48e-191b586b0076 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:34.740308 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26e1df-3b24-4420-b48e-191b586b0076 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:34.740581 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26e1df-3b24-4420-b48e-191b586b0076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:34.747664 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26e1df-3b24-4420-b48e-191b586b0076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:34.749402 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26e1df-3b24-4420-b48e-191b586b0076 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:34.763702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-6a26e1df-3b24-4420-b48e-191b586b0076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:34.763702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:34.763702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:34.763702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:34.763702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:34.763702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:34.763702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:34.763702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:34.763702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:34.763702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:34.763702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:34.763702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:34.763702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:25:34.763702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:25:34.763702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:34.765279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:34.766511 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:25:34.766511 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:25:34.766511 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:25:34.766511 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:25:34.766511 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:25:34.766511 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:25:34.766511 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:34.766511 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:34.766511 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 312/617] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:34.766511 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26e1df-3b24-4420-b48e-191b586b0076 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:34.782007 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5e327-b891-4e6a-b63b-afd06aabf449 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:34.815195 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7b3bd-e85b-4ac1-8843-e5fe41fb2e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:34.815975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7b3bd-e85b-4ac1-8843-e5fe41fb2e91 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:34.816260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7b3bd-e85b-4ac1-8843-e5fe41fb2e91 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:34.816532 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7b3bd-e85b-4ac1-8843-e5fe41fb2e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:34.827490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7b3bd-e85b-4ac1-8843-e5fe41fb2e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:34.829156 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7b3bd-e85b-4ac1-8843-e5fe41fb2e91 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:34.846383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-52f7b3bd-e85b-4ac1-8843-e5fe41fb2e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:34.846383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:34.846383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:34.846383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:34.846383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:34.846383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:34.846383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:34.846383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:34.846383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:34.846383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:34.846383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:34.846383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:34.846383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:34.846383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:34.846383 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:34.847621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:34.848704 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:34.848704 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:34.848704 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:34.848704 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:34.851007 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 306/618] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:34.852013 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7b3bd-e85b-4ac1-8843-e5fe41fb2e91 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:34.866578 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26e1df-3b24-4420-b48e-191b586b0076 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:34.874047 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:34.894385 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:34.900869 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22e92c-06a7-449a-9a5d-769fce7abc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:34.901527 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22e92c-06a7-449a-9a5d-769fce7abc68 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:34.901811 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22e92c-06a7-449a-9a5d-769fce7abc68 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:34.902083 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22e92c-06a7-449a-9a5d-769fce7abc68 None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:34.902940 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22e92c-06a7-449a-9a5d-769fce7abc68 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:34.903799 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22e92c-06a7-449a-9a5d-769fce7abc68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:34.905227 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22e92c-06a7-449a-9a5d-769fce7abc68 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:34.922506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 313/619] 10.222.0.86 () {56 vars in 1137 bytes} [Fri Jul 15 16:25:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:34.923324 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22e92c-06a7-449a-9a5d-769fce7abc68 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:34.960317 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7b3bd-e85b-4ac1-8843-e5fe41fb2e91 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:34.994027 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c388339-7a1e-4166-ae18-9f125b4a9856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:34.994821 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c388339-7a1e-4166-ae18-9f125b4a9856 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:34.995142 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c388339-7a1e-4166-ae18-9f125b4a9856 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:34.995424 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c388339-7a1e-4166-ae18-9f125b4a9856 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:35.002968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c388339-7a1e-4166-ae18-9f125b4a9856 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:35.004413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c388339-7a1e-4166-ae18-9f125b4a9856 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-0c388339-7a1e-4166-ae18-9f125b4a9856 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:25:35.018975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:35.019902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:35.020838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:35.020838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:35.020838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:25:35.020838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:25:35.020838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:25:35.020838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:25:35.020838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:25:35.020838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:25:35.020838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 16:25:35.020838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:35.020838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 307/620] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:25:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:35.021588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c388339-7a1e-4166-ae18-9f125b4a9856 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:35.021664 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22e92c-06a7-449a-9a5d-769fce7abc68 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:35.058201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986506d-0837-4615-b5e3-1c768d11029d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:35.058850 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986506d-0837-4615-b5e3-1c768d11029d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:35.059168 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986506d-0837-4615-b5e3-1c768d11029d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:35.059458 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986506d-0837-4615-b5e3-1c768d11029d None admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:35.060766 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986506d-0837-4615-b5e3-1c768d11029d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:35.061077 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986506d-0837-4615-b5e3-1c768d11029d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:35.062492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986506d-0837-4615-b5e3-1c768d11029d None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:35.074010 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 314/621] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:25:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:35.074788 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986506d-0837-4615-b5e3-1c768d11029d None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:35.102966 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:35.124687 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:35.126999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c388339-7a1e-4166-ae18-9f125b4a9856 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:35.160174 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ce7be-19d0-4991-b63c-0d09423018d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:35.160836 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ce7be-19d0-4991-b63c-0d09423018d2 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:35.161125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ce7be-19d0-4991-b63c-0d09423018d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:35.161404 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ce7be-19d0-4991-b63c-0d09423018d2 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:35.162126 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ce7be-19d0-4991-b63c-0d09423018d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:35.162442 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ce7be-19d0-4991-b63c-0d09423018d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:35.163833 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ce7be-19d0-4991-b63c-0d09423018d2 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:35.175122 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986506d-0837-4615-b5e3-1c768d11029d None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:35.175913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 308/622] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:35.176701 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ce7be-19d0-4991-b63c-0d09423018d2 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:35.212863 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad2630-e1fe-41e4-bcaa-d0091b6ec075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:35.213498 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad2630-e1fe-41e4-bcaa-d0091b6ec075 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:35.213780 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad2630-e1fe-41e4-bcaa-d0091b6ec075 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:35.214150 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad2630-e1fe-41e4-bcaa-d0091b6ec075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:35.273457 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ce7be-19d0-4991-b63c-0d09423018d2 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:35.281032 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad2630-e1fe-41e4-bcaa-d0091b6ec075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:35.282489 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad2630-e1fe-41e4-bcaa-d0091b6ec075 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:35.307613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397a18d-9827-47e9-ad87-2ed7bd4600a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:35.308273 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397a18d-9827-47e9-ad87-2ed7bd4600a4 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:35.308553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397a18d-9827-47e9-ad87-2ed7bd4600a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:35.308825 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397a18d-9827-47e9-ad87-2ed7bd4600a4 None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:35.310188 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397a18d-9827-47e9-ad87-2ed7bd4600a4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:35.310500 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397a18d-9827-47e9-ad87-2ed7bd4600a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:35.311981 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397a18d-9827-47e9-ad87-2ed7bd4600a4 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:35.321075 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:35.332685 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:35.338448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 309/623] 10.222.0.86 () {56 vars in 1139 bytes} [Fri Jul 15 16:25:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:35.339339 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397a18d-9827-47e9-ad87-2ed7bd4600a4 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:35.394145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 315/624] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:35.394934 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad2630-e1fe-41e4-bcaa-d0091b6ec075 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:35.454885 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397a18d-9827-47e9-ad87-2ed7bd4600a4 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:35.487652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbc9dd-b51d-4e27-bbfd-5fe123a63c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:35.488302 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbc9dd-b51d-4e27-bbfd-5fe123a63c99 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:35.488584 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbc9dd-b51d-4e27-bbfd-5fe123a63c99 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:35.488861 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbc9dd-b51d-4e27-bbfd-5fe123a63c99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:35.489679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbc9dd-b51d-4e27-bbfd-5fe123a63c99 None admin] RBAC: Adding query filter params (role.id=0d630eb5fff7436391281167da032c15, scope.project.id=db599cc43051468cbf306faba2431b23, user.id=f34916bd4d56411e8994d1c476885e2e) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:35.489992 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbc9dd-b51d-4e27-bbfd-5fe123a63c99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:35.491463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbc9dd-b51d-4e27-bbfd-5fe123a63c99 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:35.493555 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad2630-e1fe-41e4-bcaa-d0091b6ec075 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:35.497778 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 310/625] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:25:35 2022] GET /identity/v3/role_assignments?user.id=f34916bd4d56411e8994d1c476885e2e&scope.project.id=db599cc43051468cbf306faba2431b23&role.id=0d630eb5fff7436391281167da032c15 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:35.498561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbc9dd-b51d-4e27-bbfd-5fe123a63c99 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:35.539846 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecb0d9-122c-47e4-b910-d485e8e9ed3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:35.540857 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecb0d9-122c-47e4-b910-d485e8e9ed3b None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:35.541145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecb0d9-122c-47e4-b910-d485e8e9ed3b None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:35.541422 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecb0d9-122c-47e4-b910-d485e8e9ed3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:35.549047 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecb0d9-122c-47e4-b910-d485e8e9ed3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:35.550514 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecb0d9-122c-47e4-b910-d485e8e9ed3b None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:35.565918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-23ecb0d9-122c-47e4-b910-d485e8e9ed3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:35.565918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:35.565918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:35.565918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:35.565918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:35.565918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:35.565918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:35.565918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:35.565918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:35.565918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:35.565918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:35.565918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:35.565918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:25:35.565918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:25:35.565918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:35.567154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:35.568052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:25:35.568052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:25:35.568052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:25:35.568052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:25:35.568052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:25:35.568052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:25:35.568052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:35.568052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:35.568052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 316/626] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:35.568052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecb0d9-122c-47e4-b910-d485e8e9ed3b None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:35.575967 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:35.582503 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:35.624502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbc9dd-b51d-4e27-bbfd-5fe123a63c99 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:35.662913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1ecb0-dcba-47ee-afab-5da5caa5a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:35.663499 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1ecb0-dcba-47ee-afab-5da5caa5a416 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:35.663784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1ecb0-dcba-47ee-afab-5da5caa5a416 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:35.664061 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1ecb0-dcba-47ee-afab-5da5caa5a416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:35.697618 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecb0d9-122c-47e4-b910-d485e8e9ed3b None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:35.738660 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d836d07-1e59-46c3-ac4e-2478d832f78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:35.739505 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d836d07-1e59-46c3-ac4e-2478d832f78e None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:35.739896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d836d07-1e59-46c3-ac4e-2478d832f78e None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:35.740180 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d836d07-1e59-46c3-ac4e-2478d832f78e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:35.746313 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1ecb0-dcba-47ee-afab-5da5caa5a416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:35.748393 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1ecb0-dcba-47ee-afab-5da5caa5a416 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:35.754614 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d836d07-1e59-46c3-ac4e-2478d832f78e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:35.756128 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d836d07-1e59-46c3-ac4e-2478d832f78e None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:35.775307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-2d836d07-1e59-46c3-ac4e-2478d832f78e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:35.775307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:35.775307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:35.775307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:35.775307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:35.775307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:35.775307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:35.775307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:35.775307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:35.775307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:35.775307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:35.775307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:35.775307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:35.775307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:35.775307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:35.776220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:35.777096 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:35.777096 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:35.777096 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:35.777096 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:35.777096 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 317/627] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:35.777413 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d836d07-1e59-46c3-ac4e-2478d832f78e None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:35.816403 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:35.840795 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:35.874097 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 311/628] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:35.874097 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1ecb0-dcba-47ee-afab-5da5caa5a416 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:35.892093 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d836d07-1e59-46c3-ac4e-2478d832f78e None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:35.928543 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049731dc-8539-4ab1-a201-809c493f316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:35.929190 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049731dc-8539-4ab1-a201-809c493f316a None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:35.929482 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049731dc-8539-4ab1-a201-809c493f316a None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:35.929748 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049731dc-8539-4ab1-a201-809c493f316a None admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:35.930535 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049731dc-8539-4ab1-a201-809c493f316a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:35.930847 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049731dc-8539-4ab1-a201-809c493f316a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:35.932303 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049731dc-8539-4ab1-a201-809c493f316a None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:35.951581 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 318/629] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:35.951581 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049731dc-8539-4ab1-a201-809c493f316a None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:35.977375 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1ecb0-dcba-47ee-afab-5da5caa5a416 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:36.013835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f49d2f-d0f1-4579-9c82-4ac4235f3b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:36.014772 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f49d2f-d0f1-4579-9c82-4ac4235f3b57 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:36.014997 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f49d2f-d0f1-4579-9c82-4ac4235f3b57 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:36.015192 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f49d2f-d0f1-4579-9c82-4ac4235f3b57 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:36.015913 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f49d2f-d0f1-4579-9c82-4ac4235f3b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:36.016224 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f49d2f-d0f1-4579-9c82-4ac4235f3b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:36.017808 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f49d2f-d0f1-4579-9c82-4ac4235f3b57 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:36.029207 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 312/630] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:36.032282 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f49d2f-d0f1-4579-9c82-4ac4235f3b57 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:36.054104 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:36.058451 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049731dc-8539-4ab1-a201-809c493f316a None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:36.080724 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:36.097876 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84aece4-087f-45d6-a2a0-8ec076b5f713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:36.098663 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aece4-087f-45d6-a2a0-8ec076b5f713 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:36.098981 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aece4-087f-45d6-a2a0-8ec076b5f713 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:36.099262 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aece4-087f-45d6-a2a0-8ec076b5f713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:36.110160 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84aece4-087f-45d6-a2a0-8ec076b5f713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:36.111640 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84aece4-087f-45d6-a2a0-8ec076b5f713 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:36.129871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-d84aece4-087f-45d6-a2a0-8ec076b5f713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:36.129871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:36.129871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:36.129871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:36.129871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:36.129871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:36.129871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:36.129871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:36.129871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:36.129871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:36.129871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:36.129871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:36.129871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:36.129871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:36.129871 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:36.130775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:36.131690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:36.131690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:36.131690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:36.131690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:36.131690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 319/631] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:36.131973 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84aece4-087f-45d6-a2a0-8ec076b5f713 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:36.147412 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f49d2f-d0f1-4579-9c82-4ac4235f3b57 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:36.184685 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550869cf-2234-4155-9a2b-c6713e48e64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:36.185272 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550869cf-2234-4155-9a2b-c6713e48e64b None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:36.185561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550869cf-2234-4155-9a2b-c6713e48e64b None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:36.185838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550869cf-2234-4155-9a2b-c6713e48e64b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:36.186763 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550869cf-2234-4155-9a2b-c6713e48e64b None admin] RBAC: Adding query filter params (role.id=0d630eb5fff7436391281167da032c15, scope.project.id=db599cc43051468cbf306faba2431b23, user.id=2a518605222244f2974ab19a03e4cf93) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:36.187112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550869cf-2234-4155-9a2b-c6713e48e64b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:36.188549 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550869cf-2234-4155-9a2b-c6713e48e64b None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:36.194497 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 313/632] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:25:36 2022] GET /identity/v3/role_assignments?user.id=2a518605222244f2974ab19a03e4cf93&scope.project.id=db599cc43051468cbf306faba2431b23&role.id=0d630eb5fff7436391281167da032c15 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:36.195310 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550869cf-2234-4155-9a2b-c6713e48e64b None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:36.254838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84aece4-087f-45d6-a2a0-8ec076b5f713 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:36.301073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae14b6-9dcb-4d52-a31a-c62f57ed9846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:36.301896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae14b6-9dcb-4d52-a31a-c62f57ed9846 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:36.302184 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae14b6-9dcb-4d52-a31a-c62f57ed9846 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:36.302465 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae14b6-9dcb-4d52-a31a-c62f57ed9846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:36.311817 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:36.314702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae14b6-9dcb-4d52-a31a-c62f57ed9846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:36.316387 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae14b6-9dcb-4d52-a31a-c62f57ed9846 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:36.335281 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550869cf-2234-4155-9a2b-c6713e48e64b None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:36.335642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-5dae14b6-9dcb-4d52-a31a-c62f57ed9846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:36.335642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:36.335642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:36.335642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:36.335642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:36.335642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:36.335642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:36.335642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:36.335642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:36.335642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:36.335642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:36.335642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:36.335642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:25:36.335642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:25:36.335642 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:36.336481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:36.337384 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:25:36.337384 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:25:36.337384 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:25:36.337384 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:25:36.337384 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:25:36.337384 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:25:36.337384 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:36.337384 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:36.337384 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 320/633] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:36.343422 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae14b6-9dcb-4d52-a31a-c62f57ed9846 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:36.381775 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10708cf9-01ee-4f97-8ed3-ae0edcb9069b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:36.382442 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10708cf9-01ee-4f97-8ed3-ae0edcb9069b None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:36.382729 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10708cf9-01ee-4f97-8ed3-ae0edcb9069b None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:36.383034 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10708cf9-01ee-4f97-8ed3-ae0edcb9069b None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:36.383756 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10708cf9-01ee-4f97-8ed3-ae0edcb9069b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:36.384063 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10708cf9-01ee-4f97-8ed3-ae0edcb9069b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:36.385438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10708cf9-01ee-4f97-8ed3-ae0edcb9069b None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:36.395902 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:36.404949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 314/634] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:36.410318 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10708cf9-01ee-4f97-8ed3-ae0edcb9069b None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:36.488996 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae14b6-9dcb-4d52-a31a-c62f57ed9846 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:36.527677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c253978-5409-4bb5-b9e1-e47d66f14005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:36.529008 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c253978-5409-4bb5-b9e1-e47d66f14005 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:36.529504 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c253978-5409-4bb5-b9e1-e47d66f14005 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:36.530005 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c253978-5409-4bb5-b9e1-e47d66f14005 None admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:36.530891 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c253978-5409-4bb5-b9e1-e47d66f14005 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:36.531196 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c253978-5409-4bb5-b9e1-e47d66f14005 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:36.532933 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c253978-5409-4bb5-b9e1-e47d66f14005 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:36.540839 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10708cf9-01ee-4f97-8ed3-ae0edcb9069b None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:36.554945 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 321/635] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:36.557009 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c253978-5409-4bb5-b9e1-e47d66f14005 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:36.582919 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329392b-be4e-4fed-96e1-c415aa12f133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:36.584221 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329392b-be4e-4fed-96e1-c415aa12f133 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:36.584729 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329392b-be4e-4fed-96e1-c415aa12f133 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:36.585197 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329392b-be4e-4fed-96e1-c415aa12f133 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:36.593771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329392b-be4e-4fed-96e1-c415aa12f133 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:36.595728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329392b-be4e-4fed-96e1-c415aa12f133 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:36.611002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-5329392b-be4e-4fed-96e1-c415aa12f133 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:36.611002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:36.611002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:36.611002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:36.611002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:36.611002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:36.611002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:36.611002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:36.611002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:36.611002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:36.611002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:36.611002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:36.611002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:25:36.611002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:25:36.611002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:36.611949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:36.612852 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:25:36.612852 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:25:36.612852 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:25:36.612852 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:25:36.612852 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:25:36.612852 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:25:36.612852 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:36.612852 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:36.615184 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 315/636] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:36.621241 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329392b-be4e-4fed-96e1-c415aa12f133 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:36.639234 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:36.663048 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:36.674309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c253978-5409-4bb5-b9e1-e47d66f14005 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:36.710921 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c07063-530e-4b48-b23e-a00a78412d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:36.712077 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c07063-530e-4b48-b23e-a00a78412d4b None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:36.712559 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c07063-530e-4b48-b23e-a00a78412d4b None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:36.713030 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c07063-530e-4b48-b23e-a00a78412d4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:36.714237 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c07063-530e-4b48-b23e-a00a78412d4b None admin] RBAC: Adding query filter params (role.id=0d630eb5fff7436391281167da032c15, scope.project.id=db599cc43051468cbf306faba2431b23, user.id=a101281ae1f2474886c1ec214f042d24) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:36.714791 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c07063-530e-4b48-b23e-a00a78412d4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:36.717112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c07063-530e-4b48-b23e-a00a78412d4b None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:36.724827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 322/637] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:25:36 2022] GET /identity/v3/role_assignments?user.id=a101281ae1f2474886c1ec214f042d24&scope.project.id=db599cc43051468cbf306faba2431b23&role.id=0d630eb5fff7436391281167da032c15 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:36.748571 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329392b-be4e-4fed-96e1-c415aa12f133 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:36.789522 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929c532-9d7b-48b6-92e3-1288d0d8869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:36.790223 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929c532-9d7b-48b6-92e3-1288d0d8869b None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:36.790510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929c532-9d7b-48b6-92e3-1288d0d8869b None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:36.790789 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929c532-9d7b-48b6-92e3-1288d0d8869b None admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:36.791654 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929c532-9d7b-48b6-92e3-1288d0d8869b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:36.791973 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929c532-9d7b-48b6-92e3-1288d0d8869b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:36.793478 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929c532-9d7b-48b6-92e3-1288d0d8869b None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:36.807861 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 316/638] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:36.814059 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c07063-530e-4b48-b23e-a00a78412d4b None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:36.945610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c07063-530e-4b48-b23e-a00a78412d4b None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:36.980677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd785752-ecd5-451c-9f81-75a4c833a9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:36.981866 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd785752-ecd5-451c-9f81-75a4c833a9fb None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:36.982165 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd785752-ecd5-451c-9f81-75a4c833a9fb None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:36.982471 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd785752-ecd5-451c-9f81-75a4c833a9fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:36.983308 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd785752-ecd5-451c-9f81-75a4c833a9fb None admin] RBAC: Adding query filter params (role.id=0d630eb5fff7436391281167da032c15, scope.project.id=db599cc43051468cbf306faba2431b23, user.id=8e620f2a895241279b63327d6a7d3dae) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:36.983624 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd785752-ecd5-451c-9f81-75a4c833a9fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:36.985101 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd785752-ecd5-451c-9f81-75a4c833a9fb None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:36.991522 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 323/639] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:25:36 2022] GET /identity/v3/role_assignments?user.id=8e620f2a895241279b63327d6a7d3dae&scope.project.id=db599cc43051468cbf306faba2431b23&role.id=0d630eb5fff7436391281167da032c15 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:37.844954 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275458d-4b37-4efd-96b8-972ebe12964d None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:37.845475 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275458d-4b37-4efd-96b8-972ebe12964d None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:37.845654 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275458d-4b37-4efd-96b8-972ebe12964d None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:37.846919 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 317/640] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:37.853012 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f4fde-2b58-4e2a-b9d0-0213ed9a2789 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:37.853798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f4fde-2b58-4e2a-b9d0-0213ed9a2789 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:37.854243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f4fde-2b58-4e2a-b9d0-0213ed9a2789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:37.886834 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-194f4fde-2b58-4e2a-b9d0-0213ed9a2789 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:37.888580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-194f4fde-2b58-4e2a-b9d0-0213ed9a2789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:37.903240 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:37.961426 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 324/641] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:37.986471 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275458d-4b37-4efd-96b8-972ebe12964d None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:38.052698 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:38.099135 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275458d-4b37-4efd-96b8-972ebe12964d None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:38.135306 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d3906-62b0-4194-9b8b-a691697dfd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:38.136455 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3906-62b0-4194-9b8b-a691697dfd79 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:38.136963 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3906-62b0-4194-9b8b-a691697dfd79 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:38.137486 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3906-62b0-4194-9b8b-a691697dfd79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:38.148266 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d3906-62b0-4194-9b8b-a691697dfd79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-bd1d3906-62b0-4194-9b8b-a691697dfd79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:38.156300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:38.157289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:38.158183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:38.158183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:38.158183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:38.158183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:38.158183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:38.158183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:38.158183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:38.158183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:38.158183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:38.158183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:38.158183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:25:38.158183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:38.160920 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 318/642] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:25:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:38.170918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f4fde-2b58-4e2a-b9d0-0213ed9a2789 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:38.274579 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f4fde-2b58-4e2a-b9d0-0213ed9a2789 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:38.311624 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76e80e-ed79-42bb-8544-34995994a6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:38.312293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76e80e-ed79-42bb-8544-34995994a6fa None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:38.312622 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76e80e-ed79-42bb-8544-34995994a6fa None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:38.312904 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76e80e-ed79-42bb-8544-34995994a6fa None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:38.313648 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76e80e-ed79-42bb-8544-34995994a6fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:38.313998 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76e80e-ed79-42bb-8544-34995994a6fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:38.315400 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76e80e-ed79-42bb-8544-34995994a6fa None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:38.323984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 325/643] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:38.330368 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d3906-62b0-4194-9b8b-a691697dfd79 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:38.438528 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d3906-62b0-4194-9b8b-a691697dfd79 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:38.462480 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:38.476656 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621b9a3-4050-43f1-9f78-c61ddc4886b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:38.477895 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621b9a3-4050-43f1-9f78-c61ddc4886b0 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:38.478393 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621b9a3-4050-43f1-9f78-c61ddc4886b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:38.478921 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621b9a3-4050-43f1-9f78-c61ddc4886b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:38.493266 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621b9a3-4050-43f1-9f78-c61ddc4886b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:38.495164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621b9a3-4050-43f1-9f78-c61ddc4886b0 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:38.514017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-1621b9a3-4050-43f1-9f78-c61ddc4886b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:38.514017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:38.514017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:38.514017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:38.514017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:38.514017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:38.514017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:38.514017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:38.514017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:38.514017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:38.514017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:38.514017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:38.514017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:38.514017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:38.514017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:38.515025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:38.515890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:38.515890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:38.515890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:38.515890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:38.518125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 319/644] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:38.523412 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76e80e-ed79-42bb-8544-34995994a6fa None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:38.539843 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:38.632072 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb18aad-99fe-4ca8-bddf-b8b47c90eb07 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:38.632405 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb18aad-99fe-4ca8-bddf-b8b47c90eb07 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:38.632670 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb18aad-99fe-4ca8-bddf-b8b47c90eb07 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:38.634007 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76e80e-ed79-42bb-8544-34995994a6fa None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:38.634291 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 320/645] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:38.639882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9123e0-99cd-41ad-b668-86790e240268 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:38.640171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9123e0-99cd-41ad-b668-86790e240268 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:38.640454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9123e0-99cd-41ad-b668-86790e240268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:38.658102 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-bb9123e0-99cd-41ad-b668-86790e240268 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:38.659343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-bb9123e0-99cd-41ad-b668-86790e240268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:38.677226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe019b-883c-49dd-ab44-04eddc925e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:38.678242 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe019b-883c-49dd-ab44-04eddc925e06 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:38.678741 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe019b-883c-49dd-ab44-04eddc925e06 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:38.679319 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe019b-883c-49dd-ab44-04eddc925e06 None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:38.680419 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe019b-883c-49dd-ab44-04eddc925e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:38.680922 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe019b-883c-49dd-ab44-04eddc925e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:38.682562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe019b-883c-49dd-ab44-04eddc925e06 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:38.697304 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 326/646] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:38.703797 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe019b-883c-49dd-ab44-04eddc925e06 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:38.738217 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 321/647] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 16:25:38.761384 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9123e0-99cd-41ad-b668-86790e240268 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:38.780914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:38.819219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe019b-883c-49dd-ab44-04eddc925e06 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:38.874075 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edb04f-693a-4305-a7e9-067ceb279c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:38.874833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edb04f-693a-4305-a7e9-067ceb279c5e None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:38.875870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edb04f-693a-4305-a7e9-067ceb279c5e None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:38.875994 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edb04f-693a-4305-a7e9-067ceb279c5e None admin] PATH_INFO: `/v3/users/nova` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:38.888038 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edb04f-693a-4305-a7e9-067ceb279c5e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:38.888433 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9123e0-99cd-41ad-b668-86790e240268 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:38.891857 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:38.892179 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edb04f-693a-4305-a7e9-067ceb279c5e None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-76edb04f-693a-4305-a7e9-067ceb279c5e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:25:38.923506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:38.924554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:38.925507 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:38.925507 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:38.925507 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:25:38.925507 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:25:38.925507 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:25:38.925507 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:25:38.925507 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:25:38.925507 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:25:38.925507 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 16:25:38.925507 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:38.933451 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 327/648] 10.222.0.86 () {56 vars in 1093 bytes} [Fri Jul 15 16:25:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:38.934185 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edb04f-693a-4305-a7e9-067ceb279c5e None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:38.945463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672e225-82d6-488a-bed9-799ed0a4a6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:38.947108 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672e225-82d6-488a-bed9-799ed0a4a6f2 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:38.947689 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672e225-82d6-488a-bed9-799ed0a4a6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:38.948469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672e225-82d6-488a-bed9-799ed0a4a6f2 None admin] PATH_INFO: `/v3/services/image` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:38.949657 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672e225-82d6-488a-bed9-799ed0a4a6f2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:38.952562 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672e225-82d6-488a-bed9-799ed0a4a6f2 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-a672e225-82d6-488a-bed9-799ed0a4a6f2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:38.972466 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:38.973553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:38.974396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:38.974396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:38.974396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:38.974396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:38.974396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:38.974396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:38.974396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:38.974396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:38.974396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:38.974396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:38.974396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:25:38.974396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:38.974396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 16:25:38.974396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:38.977049 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 322/649] 10.222.0.86 () {56 vars in 1105 bytes} [Fri Jul 15 16:25:38 2022] GET /identity/v3/services/image => generated 86 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:38.982855 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672e225-82d6-488a-bed9-799ed0a4a6f2 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:39.075790 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edb04f-693a-4305-a7e9-067ceb279c5e None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:39.089167 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672e225-82d6-488a-bed9-799ed0a4a6f2 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:39.115984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:39.121719 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5cdbd-418b-4ca9-8203-40ea99495cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:39.122967 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5cdbd-418b-4ca9-8203-40ea99495cf6 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:39.123273 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5cdbd-418b-4ca9-8203-40ea99495cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:39.123542 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5cdbd-418b-4ca9-8203-40ea99495cf6 None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:39.124397 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5cdbd-418b-4ca9-8203-40ea99495cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:39.124714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5cdbd-418b-4ca9-8203-40ea99495cf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:39.126149 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5cdbd-418b-4ca9-8203-40ea99495cf6 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:39.127972 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38b2d4-0dab-4107-8bb7-5878b97b93f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:39.128832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38b2d4-0dab-4107-8bb7-5878b97b93f6 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:39.129312 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38b2d4-0dab-4107-8bb7-5878b97b93f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:39.129768 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38b2d4-0dab-4107-8bb7-5878b97b93f6 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:39.130643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38b2d4-0dab-4107-8bb7-5878b97b93f6 None admin] RBAC: Adding query filter params (name=image) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:39.131207 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38b2d4-0dab-4107-8bb7-5878b97b93f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:39.132776 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38b2d4-0dab-4107-8bb7-5878b97b93f6 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:39.142784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 323/650] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:39.142784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec86a91-2e8f-4ecc-a765-19ba24dbacc8 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:39.142784 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec86a91-2e8f-4ecc-a765-19ba24dbacc8 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:39.143209 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec86a91-2e8f-4ecc-a765-19ba24dbacc8 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:39.144326 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 324/651] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:39.148326 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 328/652] 10.222.0.86 () {56 vars in 1133 bytes} [Fri Jul 15 16:25:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:39.148807 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec86a91-2e8f-4ecc-a765-19ba24dbacc8 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:39.149610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af55d7-b62b-49a4-875a-4861b5998bec None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:39.149900 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af55d7-b62b-49a4-875a-4861b5998bec None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:39.150182 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af55d7-b62b-49a4-875a-4861b5998bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:39.167870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-c5af55d7-b62b-49a4-875a-4861b5998bec None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:39.169622 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-c5af55d7-b62b-49a4-875a-4861b5998bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:39.184787 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:39.245483 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 329/653] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:39.246355 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af55d7-b62b-49a4-875a-4861b5998bec None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:39.272457 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec86a91-2e8f-4ecc-a765-19ba24dbacc8 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:39.308362 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de963c-1756-47b7-9b21-e7a3169cca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:39.309027 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de963c-1756-47b7-9b21-e7a3169cca6a None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:39.309316 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de963c-1756-47b7-9b21-e7a3169cca6a None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:39.310112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de963c-1756-47b7-9b21-e7a3169cca6a None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:39.310818 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de963c-1756-47b7-9b21-e7a3169cca6a None admin] RBAC: Adding query filter params (type=image) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:39.311209 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de963c-1756-47b7-9b21-e7a3169cca6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:39.312565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de963c-1756-47b7-9b21-e7a3169cca6a None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:39.318351 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 325/654] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:39.327975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de963c-1756-47b7-9b21-e7a3169cca6a None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:39.361566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af55d7-b62b-49a4-875a-4861b5998bec None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:39.386103 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:39.402718 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5386f-fdfc-446c-992d-e6fc93a6c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:39.403487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5386f-fdfc-446c-992d-e6fc93a6c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:39.403775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5386f-fdfc-446c-992d-e6fc93a6c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:39.404056 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5386f-fdfc-446c-992d-e6fc93a6c3b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:39.448722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:39.456902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de963c-1756-47b7-9b21-e7a3169cca6a None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:39.485248 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5386f-fdfc-446c-992d-e6fc93a6c3b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:39.486825 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5386f-fdfc-446c-992d-e6fc93a6c3b9 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:39.495289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b89362-4231-49bc-8f1b-c9f93b0bcd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:39.496180 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b89362-4231-49bc-8f1b-c9f93b0bcd4d None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:39.496411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b89362-4231-49bc-8f1b-c9f93b0bcd4d None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:39.496690 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b89362-4231-49bc-8f1b-c9f93b0bcd4d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:39.497899 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b89362-4231-49bc-8f1b-c9f93b0bcd4d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:39.499938 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b89362-4231-49bc-8f1b-c9f93b0bcd4d None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-65b89362-4231-49bc-8f1b-c9f93b0bcd4d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:39.513270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:39.514413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:39.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:39.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:39.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:39.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:39.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:39.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:39.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:39.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:39.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:39.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:39.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:39.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:25:39.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:39.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 16:25:39.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:39.518026 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 326/655] 10.222.0.86 () {56 vars in 1129 bytes} [Fri Jul 15 16:25:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:39.519463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b0360-75e6-4bb0-8aef-9f639480cbb6 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:39.519747 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b0360-75e6-4bb0-8aef-9f639480cbb6 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:39.520021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b0360-75e6-4bb0-8aef-9f639480cbb6 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:39.521396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 327/656] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:39.525951 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b0360-75e6-4bb0-8aef-9f639480cbb6 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:39.613770 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 330/657] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 16:25:39.613770 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd56004-6e52-494c-8057-4c67bdec791c None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:39.613770 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd56004-6e52-494c-8057-4c67bdec791c None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:39.613770 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd56004-6e52-494c-8057-4c67bdec791c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:39.627795 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-bfd56004-6e52-494c-8057-4c67bdec791c None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:39.628984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-bfd56004-6e52-494c-8057-4c67bdec791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:39.642891 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b0360-75e6-4bb0-8aef-9f639480cbb6 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:39.644290 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:39.683604 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55305b2-c4de-49eb-8a26-89c0e81615f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:39.684700 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55305b2-c4de-49eb-8a26-89c0e81615f3 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:39.685173 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55305b2-c4de-49eb-8a26-89c0e81615f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:39.685664 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55305b2-c4de-49eb-8a26-89c0e81615f3 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:39.686549 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55305b2-c4de-49eb-8a26-89c0e81615f3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:39.687082 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55305b2-c4de-49eb-8a26-89c0e81615f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:39.688529 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55305b2-c4de-49eb-8a26-89c0e81615f3 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:39.697900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 328/658] 10.222.0.86 () {56 vars in 1124 bytes} [Fri Jul 15 16:25:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:39.697900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55305b2-c4de-49eb-8a26-89c0e81615f3 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:39.710937 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 331/659] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:39.710937 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd56004-6e52-494c-8057-4c67bdec791c None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:39.732080 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:39.814881 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55305b2-c4de-49eb-8a26-89c0e81615f3 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:39.821884 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd56004-6e52-494c-8057-4c67bdec791c None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:39.852399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81820a-06ec-4a16-bb9d-32bedd6a087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:39.853204 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81820a-06ec-4a16-bb9d-32bedd6a087b None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:39.853483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81820a-06ec-4a16-bb9d-32bedd6a087b None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:39.853756 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81820a-06ec-4a16-bb9d-32bedd6a087b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:39.864675 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81820a-06ec-4a16-bb9d-32bedd6a087b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:39.866438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81820a-06ec-4a16-bb9d-32bedd6a087b None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:39.868845 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bce31-5e90-40c2-9403-3ac90f2d7a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:39.869971 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bce31-5e90-40c2-9403-3ac90f2d7a10 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:39.870405 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bce31-5e90-40c2-9403-3ac90f2d7a10 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:39.870834 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bce31-5e90-40c2-9403-3ac90f2d7a10 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:39.871717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bce31-5e90-40c2-9403-3ac90f2d7a10 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:39.872679 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bce31-5e90-40c2-9403-3ac90f2d7a10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:39.874602 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bce31-5e90-40c2-9403-3ac90f2d7a10 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:39.890925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-6e81820a-06ec-4a16-bb9d-32bedd6a087b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:39.890925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:39.890925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:39.890925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:39.890925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:39.890925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:39.890925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:39.890925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:39.890925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:39.890925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:39.890925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:39.890925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:39.890925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:39.890925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:39.890925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:39.892262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:39.893405 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:39.893405 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:39.893405 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:39.893405 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:39.893405 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 329/660] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:39.893405 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81820a-06ec-4a16-bb9d-32bedd6a087b None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:39.893981 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 332/661] 10.222.0.86 () {56 vars in 1124 bytes} [Fri Jul 15 16:25:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:39.895701 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bce31-5e90-40c2-9403-3ac90f2d7a10 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:39.918466 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:40.012852 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:40.024648 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bce31-5e90-40c2-9403-3ac90f2d7a10 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:40.038794 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81820a-06ec-4a16-bb9d-32bedd6a087b None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:40.066596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecedbd-29f4-43e9-bf6b-74e3475f6340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:40.067920 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecedbd-29f4-43e9-bf6b-74e3475f6340 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:40.068441 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecedbd-29f4-43e9-bf6b-74e3475f6340 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:40.068921 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecedbd-29f4-43e9-bf6b-74e3475f6340 None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:40.069986 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecedbd-29f4-43e9-bf6b-74e3475f6340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:40.070504 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecedbd-29f4-43e9-bf6b-74e3475f6340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:40.072328 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecedbd-29f4-43e9-bf6b-74e3475f6340 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:40.075988 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b2dc3-e022-45a9-ad70-199bb848c20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:40.076814 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b2dc3-e022-45a9-ad70-199bb848c20f None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:40.077089 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b2dc3-e022-45a9-ad70-199bb848c20f None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:40.077377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b2dc3-e022-45a9-ad70-199bb848c20f None admin] PATH_INFO: `/v3/services/network` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:40.078034 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b2dc3-e022-45a9-ad70-199bb848c20f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:40.079547 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b2dc3-e022-45a9-ad70-199bb848c20f None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:40.089121 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 333/662] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-8d1b2dc3-e022-45a9-ad70-199bb848c20f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:40.096179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:40.097164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:40.098030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:40.098030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:40.098030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:40.098030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:40.098030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:40.098030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:40.098030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:40.098030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:40.098030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:40.098030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:40.098030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:25:40.098030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:40.098030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 16:25:40.098030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:40.098782 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecedbd-29f4-43e9-bf6b-74e3475f6340 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:40.101849 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 330/663] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:39 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:40.107754 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b2dc3-e022-45a9-ad70-199bb848c20f None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:40.182619 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:40.212040 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecedbd-29f4-43e9-bf6b-74e3475f6340 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:40.223525 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b2dc3-e022-45a9-ad70-199bb848c20f None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:40.258893 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19e73d-785c-4f1f-840c-71042abcff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:40.258893 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e73d-785c-4f1f-840c-71042abcff61 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:40.258893 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e73d-785c-4f1f-840c-71042abcff61 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:40.258893 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e73d-785c-4f1f-840c-71042abcff61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:40.260588 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19e73d-785c-4f1f-840c-71042abcff61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:40.262035 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19e73d-785c-4f1f-840c-71042abcff61 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:40.269918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fab597-5068-429a-956a-c6c64e435fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:40.270509 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fab597-5068-429a-956a-c6c64e435fc8 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:40.270803 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fab597-5068-429a-956a-c6c64e435fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:40.271136 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fab597-5068-429a-956a-c6c64e435fc8 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:40.271854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fab597-5068-429a-956a-c6c64e435fc8 None admin] RBAC: Adding query filter params (name=network) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:40.272173 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fab597-5068-429a-956a-c6c64e435fc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:40.273526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fab597-5068-429a-956a-c6c64e435fc8 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:40.278907 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 331/664] 10.222.0.86 () {56 vars in 1112 bytes} [Fri Jul 15 16:25:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:40.283921 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fab597-5068-429a-956a-c6c64e435fc8 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:40.285798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-8f19e73d-785c-4f1f-840c-71042abcff61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:40.285798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:40.285798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:40.285798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:40.285798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:40.285798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:40.285798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:40.285798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:40.285798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:40.285798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:40.285798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:40.285798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:40.285798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:25:40.285798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:25:40.285798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:40.286716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:40.287636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:25:40.287636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:25:40.287636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:25:40.287636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:25:40.287636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:25:40.287636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:25:40.287636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:40.287636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:40.287636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 334/665] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:40.293112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:40.295622 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19e73d-785c-4f1f-840c-71042abcff61 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:40.405667 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19e73d-785c-4f1f-840c-71042abcff61 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:40.406324 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fab597-5068-429a-956a-c6c64e435fc8 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:40.451181 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94658cea-f106-4136-83d3-590279efd1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:40.452050 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94658cea-f106-4136-83d3-590279efd1cf None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:40.452159 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94658cea-f106-4136-83d3-590279efd1cf None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:40.452399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94658cea-f106-4136-83d3-590279efd1cf None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:40.458892 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94658cea-f106-4136-83d3-590279efd1cf None admin] RBAC: Adding query filter params (type=network) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:40.458892 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94658cea-f106-4136-83d3-590279efd1cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:40.458892 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94658cea-f106-4136-83d3-590279efd1cf None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:40.459213 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715e9b4-e7a3-4a08-9a5c-22fc7a6c8afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:40.459213 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715e9b4-e7a3-4a08-9a5c-22fc7a6c8afd None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:40.459213 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715e9b4-e7a3-4a08-9a5c-22fc7a6c8afd None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:40.459213 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715e9b4-e7a3-4a08-9a5c-22fc7a6c8afd None admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:40.459541 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715e9b4-e7a3-4a08-9a5c-22fc7a6c8afd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:40.459541 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715e9b4-e7a3-4a08-9a5c-22fc7a6c8afd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:40.460921 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715e9b4-e7a3-4a08-9a5c-22fc7a6c8afd None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:40.467041 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 332/666] 10.222.0.86 () {56 vars in 1112 bytes} [Fri Jul 15 16:25:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:40.470085 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:40.482309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 335/667] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:40.490852 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94658cea-f106-4136-83d3-590279efd1cf None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:40.564737 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:40.604181 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94658cea-f106-4136-83d3-590279efd1cf None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:40.642858 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8fa3c-a5f2-45bd-9bb0-197338be00ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:40.643589 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8fa3c-a5f2-45bd-9bb0-197338be00ec None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:40.643893 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8fa3c-a5f2-45bd-9bb0-197338be00ec None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:40.644153 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8fa3c-a5f2-45bd-9bb0-197338be00ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:40.645050 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8fa3c-a5f2-45bd-9bb0-197338be00ec None admin] RBAC: Adding query filter params (role.id=923dd61feaca45d0933a4601fb2c065b, scope.project.id=db599cc43051468cbf306faba2431b23, user.id=f34916bd4d56411e8994d1c476885e2e) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:40.645373 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8fa3c-a5f2-45bd-9bb0-197338be00ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:40.646816 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8fa3c-a5f2-45bd-9bb0-197338be00ec None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:40.653599 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 333/668] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:25:40 2022] GET /identity/v3/role_assignments?user.id=f34916bd4d56411e8994d1c476885e2e&scope.project.id=db599cc43051468cbf306faba2431b23&role.id=923dd61feaca45d0933a4601fb2c065b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:41.615049 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ed3c2-4653-4d97-892a-1ca2fae563d6 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:41.615572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ed3c2-4653-4d97-892a-1ca2fae563d6 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:41.615572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ed3c2-4653-4d97-892a-1ca2fae563d6 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:41.617257 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 336/669] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:41.623029 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab477f-7ae3-4e18-989f-1209d785b970 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:41.623533 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab477f-7ae3-4e18-989f-1209d785b970 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:41.623623 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab477f-7ae3-4e18-989f-1209d785b970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:41.641886 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-aeab477f-7ae3-4e18-989f-1209d785b970 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:41.643121 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-aeab477f-7ae3-4e18-989f-1209d785b970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:41.717996 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 334/670] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:41.741255 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ed3c2-4653-4d97-892a-1ca2fae563d6 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:41.853862 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ed3c2-4653-4d97-892a-1ca2fae563d6 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:41.891708 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e17a41-9fca-4b1e-b922-a3e8f44e2017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:41.892383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e17a41-9fca-4b1e-b922-a3e8f44e2017 None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:41.892671 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e17a41-9fca-4b1e-b922-a3e8f44e2017 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:41.892954 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e17a41-9fca-4b1e-b922-a3e8f44e2017 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:41.893688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e17a41-9fca-4b1e-b922-a3e8f44e2017 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:41.895081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e17a41-9fca-4b1e-b922-a3e8f44e2017 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:41.916402 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 337/671] 10.222.0.86 () {60 vars in 1141 bytes} [Fri Jul 15 16:25:41 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:25:42.250119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7041b75-af4f-480b-8bc3-6b189df15f73 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:42.250507 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7041b75-af4f-480b-8bc3-6b189df15f73 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:42.250687 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7041b75-af4f-480b-8bc3-6b189df15f73 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:42.252346 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 335/672] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:42.257614 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef713e-f0a7-4bee-a678-62fd2e32aa2d None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:42.257911 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef713e-f0a7-4bee-a678-62fd2e32aa2d None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:42.258194 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef713e-f0a7-4bee-a678-62fd2e32aa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:42.275715 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-c8ef713e-f0a7-4bee-a678-62fd2e32aa2d None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:42.276896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-c8ef713e-f0a7-4bee-a678-62fd2e32aa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:42.328234 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:42.359937 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 338/673] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:42 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:42.383703 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7041b75-af4f-480b-8bc3-6b189df15f73 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:42.449620 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:42.492633 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7041b75-af4f-480b-8bc3-6b189df15f73 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:42.530819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80caa22c-d312-4918-8a7d-1c6c825a73e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:42.531449 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caa22c-d312-4918-8a7d-1c6c825a73e6 None admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:42.531732 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caa22c-d312-4918-8a7d-1c6c825a73e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:42.532014 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caa22c-d312-4918-8a7d-1c6c825a73e6 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:42.532757 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80caa22c-d312-4918-8a7d-1c6c825a73e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:42.534128 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80caa22c-d312-4918-8a7d-1c6c825a73e6 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:42.551558 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 336/674] 10.222.0.86 () {60 vars in 1141 bytes} [Fri Jul 15 16:25:42 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:25:42.821549 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fed8ef-2404-44d1-a001-b256e70b013e None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:42.822044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fed8ef-2404-44d1-a001-b256e70b013e None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:42.822298 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fed8ef-2404-44d1-a001-b256e70b013e None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:42.824077 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 339/675] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:42.830424 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e145151-3696-49df-a44a-eeb05bbe4e02 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:42.830852 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e145151-3696-49df-a44a-eeb05bbe4e02 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:42.831235 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e145151-3696-49df-a44a-eeb05bbe4e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:42.848818 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-1e145151-3696-49df-a44a-eeb05bbe4e02 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:42.850015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-1e145151-3696-49df-a44a-eeb05bbe4e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:42.931627 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 337/676] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:42 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 16:25:42.959766 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fed8ef-2404-44d1-a001-b256e70b013e None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:43.052885 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1002eb-a213-4ee7-b4cc-75724c8f077c None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:43.053214 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1002eb-a213-4ee7-b4cc-75724c8f077c None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:43.053492 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1002eb-a213-4ee7-b4cc-75724c8f077c None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:43.055313 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 338/677] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:25:43.060313 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e361a-f14d-4e27-bc8c-77cf17e67b92 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:43.060606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e361a-f14d-4e27-bc8c-77cf17e67b92 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:43.060895 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e361a-f14d-4e27-bc8c-77cf17e67b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:43.070906 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fed8ef-2404-44d1-a001-b256e70b013e None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:43.079668 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-e64e361a-f14d-4e27-bc8c-77cf17e67b92 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:43.080798 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-e64e361a-f14d-4e27-bc8c-77cf17e67b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:43.107033 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e3d19-f73f-4d45-9fb8-040e3a5fd2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:43.107838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e3d19-f73f-4d45-9fb8-040e3a5fd2e8 None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:43.108126 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e3d19-f73f-4d45-9fb8-040e3a5fd2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:43.108401 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e3d19-f73f-4d45-9fb8-040e3a5fd2e8 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:43.109120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e3d19-f73f-4d45-9fb8-040e3a5fd2e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:43.110721 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e3d19-f73f-4d45-9fb8-040e3a5fd2e8 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:43.126448 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 340/678] 10.222.0.86 () {60 vars in 1141 bytes} [Fri Jul 15 16:25:42 2022] POST /identity/v3/services => generated 240 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:25:43.137589 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:43.178061 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 339/679] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:43 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 16:25:43.202418 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e3d19-f73f-4d45-9fb8-040e3a5fd2e8 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:43.253651 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:43.319566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e3d19-f73f-4d45-9fb8-040e3a5fd2e8 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:43.359280 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abab365-5918-4c9b-a18b-d2af99f32cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:43.359999 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abab365-5918-4c9b-a18b-d2af99f32cd3 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:43.360280 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abab365-5918-4c9b-a18b-d2af99f32cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:43.360550 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abab365-5918-4c9b-a18b-d2af99f32cd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:43.371409 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abab365-5918-4c9b-a18b-d2af99f32cd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-7abab365-5918-4c9b-a18b-d2af99f32cd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:43.379567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:43.380512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:43.381597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:43.381597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:43.381597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:43.381597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:43.381597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:43.381597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:43.381597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:43.381597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:43.381597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:43.381597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:43.381597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:25:43.381597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:43.381597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 341/680] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:25:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:43.387793 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e361a-f14d-4e27-bc8c-77cf17e67b92 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:43.490639 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e361a-f14d-4e27-bc8c-77cf17e67b92 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:43.529060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bc570-8286-4195-913e-afe84cf7ae90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:43.529750 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bc570-8286-4195-913e-afe84cf7ae90 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:43.530040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bc570-8286-4195-913e-afe84cf7ae90 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:43.530321 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bc570-8286-4195-913e-afe84cf7ae90 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:43.531106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bc570-8286-4195-913e-afe84cf7ae90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:43.531418 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bc570-8286-4195-913e-afe84cf7ae90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:43.532796 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bc570-8286-4195-913e-afe84cf7ae90 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:43.542217 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 340/681] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:43.548394 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abab365-5918-4c9b-a18b-d2af99f32cd3 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:43.654001 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:43.657669 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abab365-5918-4c9b-a18b-d2af99f32cd3 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:43.694243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf986c02-44b4-4abd-a76c-c57dc41d6b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:43.695065 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf986c02-44b4-4abd-a76c-c57dc41d6b6a None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:43.695352 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf986c02-44b4-4abd-a76c-c57dc41d6b6a None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:43.695633 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf986c02-44b4-4abd-a76c-c57dc41d6b6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:43.707482 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf986c02-44b4-4abd-a76c-c57dc41d6b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:43.708937 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf986c02-44b4-4abd-a76c-c57dc41d6b6a None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:43.727421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-bf986c02-44b4-4abd-a76c-c57dc41d6b6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:43.727421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:43.727421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:43.727421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:43.727421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:43.727421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:43.727421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:43.727421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:43.727421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:43.727421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:43.727421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:43.727421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:43.727421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:43.727421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:43.727421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:43.728383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:43.729262 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:43.729262 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:43.729262 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:43.729262 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:43.729262 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 342/682] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:43.734568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bc570-8286-4195-913e-afe84cf7ae90 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:43.774536 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:43.846000 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bc570-8286-4195-913e-afe84cf7ae90 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:43.884939 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada272d2-6c5a-48bc-81f2-31d1e368f63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:43.885603 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada272d2-6c5a-48bc-81f2-31d1e368f63e None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:43.885883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada272d2-6c5a-48bc-81f2-31d1e368f63e None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:43.886157 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada272d2-6c5a-48bc-81f2-31d1e368f63e None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:43.886965 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada272d2-6c5a-48bc-81f2-31d1e368f63e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:43.887273 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada272d2-6c5a-48bc-81f2-31d1e368f63e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:43.889240 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada272d2-6c5a-48bc-81f2-31d1e368f63e None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:43.902252 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 341/683] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:43.908040 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf986c02-44b4-4abd-a76c-c57dc41d6b6a None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:44.016512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf986c02-44b4-4abd-a76c-c57dc41d6b6a None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:44.052303 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080b826-28da-4160-8ddf-f1c2940258b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:44.053099 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080b826-28da-4160-8ddf-f1c2940258b5 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:44.053389 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080b826-28da-4160-8ddf-f1c2940258b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:44.053671 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080b826-28da-4160-8ddf-f1c2940258b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:44.061658 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080b826-28da-4160-8ddf-f1c2940258b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:44.063134 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080b826-28da-4160-8ddf-f1c2940258b5 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-7080b826-28da-4160-8ddf-f1c2940258b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:25:44.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:44.079243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:44.081172 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:44.081172 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:44.081172 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:25:44.081172 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:25:44.081172 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:25:44.081172 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:25:44.081172 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:25:44.081172 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:25:44.081172 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 16:25:44.081172 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:44.081172 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 343/684] 10.222.0.86 () {56 vars in 1093 bytes} [Fri Jul 15 16:25:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:44.085532 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada272d2-6c5a-48bc-81f2-31d1e368f63e None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:44.192406 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada272d2-6c5a-48bc-81f2-31d1e368f63e None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:44.195055 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:44.229160 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d067de0-524e-4f0b-ab5d-8fec050ac762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:44.229839 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d067de0-524e-4f0b-ab5d-8fec050ac762 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:44.230126 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d067de0-524e-4f0b-ab5d-8fec050ac762 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:44.230407 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d067de0-524e-4f0b-ab5d-8fec050ac762 None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:44.232158 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d067de0-524e-4f0b-ab5d-8fec050ac762 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:44.232480 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d067de0-524e-4f0b-ab5d-8fec050ac762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:44.233932 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d067de0-524e-4f0b-ab5d-8fec050ac762 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:44.252614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 342/685] 10.222.0.86 () {56 vars in 1133 bytes} [Fri Jul 15 16:25:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:44.258074 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080b826-28da-4160-8ddf-f1c2940258b5 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:44.273905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:44.288006 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc160f7-8b6f-40c4-bd83-a01edd23974e None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:44.288699 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc160f7-8b6f-40c4-bd83-a01edd23974e None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:44.289194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc160f7-8b6f-40c4-bd83-a01edd23974e None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:44.291602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 343/686] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:25:44.298178 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86d7eb-e216-4e0f-9fe1-105f3bdae3c1 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:44.298329 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86d7eb-e216-4e0f-9fe1-105f3bdae3c1 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:44.298892 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86d7eb-e216-4e0f-9fe1-105f3bdae3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:44.318090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-5b86d7eb-e216-4e0f-9fe1-105f3bdae3c1 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:44.319357 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-5b86d7eb-e216-4e0f-9fe1-105f3bdae3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:44.387764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080b826-28da-4160-8ddf-f1c2940258b5 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:44.434894 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 344/687] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:44 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 16:25:44.435096 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7aabc0-4e68-4282-8362-8b34803db067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:44.435096 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7aabc0-4e68-4282-8362-8b34803db067 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:44.435096 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7aabc0-4e68-4282-8362-8b34803db067 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:44.435096 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7aabc0-4e68-4282-8362-8b34803db067 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:44.454013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7aabc0-4e68-4282-8362-8b34803db067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:44.454013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7aabc0-4e68-4282-8362-8b34803db067 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:44.455286 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86d7eb-e216-4e0f-9fe1-105f3bdae3c1 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:44.470145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-bb7aabc0-4e68-4282-8362-8b34803db067 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:44.470145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:44.470145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:44.470145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:44.470145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:44.470145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:44.470145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:44.470145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:44.470145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:44.470145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:44.470145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:44.470145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:44.470145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:44.470145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:44.470145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:44.471299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:44.472232 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:44.472232 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:44.472232 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:44.472232 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:44.482894 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 344/688] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:44.482894 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7aabc0-4e68-4282-8362-8b34803db067 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:44.557057 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:44.603213 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7aabc0-4e68-4282-8362-8b34803db067 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:44.612588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:44.643239 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bc415-0c29-474d-b743-203080dc3b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:44.644187 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bc415-0c29-474d-b743-203080dc3b28 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:44.644484 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bc415-0c29-474d-b743-203080dc3b28 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:44.644768 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bc415-0c29-474d-b743-203080dc3b28 None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:44.645501 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991bc415-0c29-474d-b743-203080dc3b28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:44.645608 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86d7eb-e216-4e0f-9fe1-105f3bdae3c1 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:44.645815 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991bc415-0c29-474d-b743-203080dc3b28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:44.647357 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991bc415-0c29-474d-b743-203080dc3b28 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:44.667269 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 345/689] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:44.668473 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bc415-0c29-474d-b743-203080dc3b28 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:44.725829 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49e472-208e-4175-9500-d67db11ec905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:44.730899 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49e472-208e-4175-9500-d67db11ec905 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:44.730899 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49e472-208e-4175-9500-d67db11ec905 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:44.730899 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49e472-208e-4175-9500-d67db11ec905 None admin] PATH_INFO: `/v3/services/image` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:44.734891 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49e472-208e-4175-9500-d67db11ec905 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:44.742890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49e472-208e-4175-9500-d67db11ec905 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-5f49e472-208e-4175-9500-d67db11ec905 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:44.773542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:44.774915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:44.775752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:44.775752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:44.775752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:44.775752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:44.775752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:44.775752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:44.775752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:44.775752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:44.775752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:44.775752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:44.775752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:25:44.775752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:44.775752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 16:25:44.775752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:44.775752 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 345/690] 10.222.0.86 () {56 vars in 1105 bytes} [Fri Jul 15 16:25:44 2022] GET /identity/v3/services/image => generated 86 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:44.781388 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49e472-208e-4175-9500-d67db11ec905 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:44.790890 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bc415-0c29-474d-b743-203080dc3b28 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:44.822910 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:44.840315 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd5f0e-483c-4187-95ef-f3de7da811a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:44.841427 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd5f0e-483c-4187-95ef-f3de7da811a3 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:44.841862 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd5f0e-483c-4187-95ef-f3de7da811a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:44.842295 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd5f0e-483c-4187-95ef-f3de7da811a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:44.851051 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd5f0e-483c-4187-95ef-f3de7da811a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:44.852715 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd5f0e-483c-4187-95ef-f3de7da811a3 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:44.869625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-f6cd5f0e-483c-4187-95ef-f3de7da811a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:44.869625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:44.869625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:44.869625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:44.869625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:44.869625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:44.869625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:44.869625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:44.869625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:44.869625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:44.869625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:44.869625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:44.869625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:25:44.869625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:25:44.869625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:44.870601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:44.871539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:25:44.871539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:25:44.871539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:25:44.871539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:25:44.871539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:25:44.871539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:25:44.871539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:44.871539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:44.877791 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 346/691] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:44.877791 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75b47b-d39a-4442-82a3-631786a85a92 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:44.877791 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75b47b-d39a-4442-82a3-631786a85a92 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:44.877791 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75b47b-d39a-4442-82a3-631786a85a92 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:44.880854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 347/692] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:44.881586 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75b47b-d39a-4442-82a3-631786a85a92 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:44.937401 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49e472-208e-4175-9500-d67db11ec905 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:44.985050 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de3fc6-a11a-4701-a094-864d899ea758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:44.985641 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de3fc6-a11a-4701-a094-864d899ea758 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:44.985924 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de3fc6-a11a-4701-a094-864d899ea758 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:44.986203 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de3fc6-a11a-4701-a094-864d899ea758 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:44.986935 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de3fc6-a11a-4701-a094-864d899ea758 None admin] RBAC: Adding query filter params (name=image) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:44.987247 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de3fc6-a11a-4701-a094-864d899ea758 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:44.988664 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de3fc6-a11a-4701-a094-864d899ea758 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:44.993648 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 346/693] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:44.999276 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d087e-427d-4402-9138-7882491a7c21 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:44.999619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d087e-427d-4402-9138-7882491a7c21 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:44.999904 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d087e-427d-4402-9138-7882491a7c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:45.013542 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75b47b-d39a-4442-82a3-631786a85a92 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:45.018455 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-2f9d087e-427d-4402-9138-7882491a7c21 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:45.020068 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-2f9d087e-427d-4402-9138-7882491a7c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:45.030425 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:45.052778 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8131c-70e5-4e8e-97a5-c503384cadbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:45.053435 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8131c-70e5-4e8e-97a5-c503384cadbb None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:45.053716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8131c-70e5-4e8e-97a5-c503384cadbb None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:45.053991 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8131c-70e5-4e8e-97a5-c503384cadbb None admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:45.054771 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8131c-70e5-4e8e-97a5-c503384cadbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:45.055100 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8131c-70e5-4e8e-97a5-c503384cadbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:45.056522 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8131c-70e5-4e8e-97a5-c503384cadbb None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:45.068811 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 348/694] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:45.069625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8131c-70e5-4e8e-97a5-c503384cadbb None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:45.102544 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 347/695] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:44 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:25:45.103505 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d087e-427d-4402-9138-7882491a7c21 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:45.127033 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:45.186531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8131c-70e5-4e8e-97a5-c503384cadbb None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:45.220509 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d087e-427d-4402-9138-7882491a7c21 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:45.222491 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7abd6-40c3-48ee-b924-d9319583121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:45.223430 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7abd6-40c3-48ee-b924-d9319583121f None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:45.223856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7abd6-40c3-48ee-b924-d9319583121f None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:45.224285 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7abd6-40c3-48ee-b924-d9319583121f None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:45.225125 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7abd6-40c3-48ee-b924-d9319583121f None admin] RBAC: Adding query filter params (type=image) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:45.225573 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7abd6-40c3-48ee-b924-d9319583121f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:45.227204 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7abd6-40c3-48ee-b924-d9319583121f None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:45.232471 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 349/696] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:45.233650 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7abd6-40c3-48ee-b924-d9319583121f None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:45.259175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433148c-0380-421e-bd97-1901fc6d71e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:45.259973 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433148c-0380-421e-bd97-1901fc6d71e8 None admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:45.260247 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433148c-0380-421e-bd97-1901fc6d71e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:45.260522 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433148c-0380-421e-bd97-1901fc6d71e8 None admin] PATH_INFO: `/v3/projects/db599cc43051468cbf306faba2431b23/users/f34916bd4d56411e8994d1c476885e2e/roles/923dd61feaca45d0933a4601fb2c065b` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:45.263126 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433148c-0380-421e-bd97-1901fc6d71e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=db599cc43051468cbf306faba2431b23, user_id=f34916bd4d56411e8994d1c476885e2e, role_id=923dd61feaca45d0933a4601fb2c065b)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:45.264559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433148c-0380-421e-bd97-1901fc6d71e8 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:45.279324 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 348/697] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:25:45 2022] PUT /identity/v3/projects/db599cc43051468cbf306faba2431b23/users/f34916bd4d56411e8994d1c476885e2e/roles/923dd61feaca45d0933a4601fb2c065b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:25:45.280134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433148c-0380-421e-bd97-1901fc6d71e8 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:45.282631 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:45.372835 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7abd6-40c3-48ee-b924-d9319583121f None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:45.384909 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:45.415380 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5fe0a-8615-4dfa-abde-8548added547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:45.416379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5fe0a-8615-4dfa-abde-8548added547 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:45.416687 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5fe0a-8615-4dfa-abde-8548added547 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:45.417235 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5fe0a-8615-4dfa-abde-8548added547 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:45.417720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5fe0a-8615-4dfa-abde-8548added547 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:45.419853 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5fe0a-8615-4dfa-abde-8548added547 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:45.428774 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433148c-0380-421e-bd97-1901fc6d71e8 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-53f5fe0a-8615-4dfa-abde-8548added547 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:45.435646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:45.436833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:45.437826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:45.437826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:45.437826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:45.437826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:45.437826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:45.437826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:45.437826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:45.437826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:45.437826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:45.437826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:45.437826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:45.437826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:25:45.437826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:45.437826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 16:25:45.437826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:45.442304 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 350/698] 10.222.0.86 () {56 vars in 1129 bytes} [Fri Jul 15 16:25:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:45.443573 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5fe0a-8615-4dfa-abde-8548added547 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:45.478953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9c1f5-cca6-4d5d-88b8-906d412f8b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:45.479803 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9c1f5-cca6-4d5d-88b8-906d412f8b56 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:45.480190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9c1f5-cca6-4d5d-88b8-906d412f8b56 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:45.480566 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9c1f5-cca6-4d5d-88b8-906d412f8b56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:45.482085 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9c1f5-cca6-4d5d-88b8-906d412f8b56 None admin] RBAC: Adding query filter params (interface=public, service_id=e7937bf4423546d6b3ce6fabe25a309f, region_id=RegionOne) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:45.482407 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9c1f5-cca6-4d5d-88b8-906d412f8b56 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:45.483961 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9c1f5-cca6-4d5d-88b8-906d412f8b56 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:45.497217 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 349/699] 10.222.0.86 () {56 vars in 1251 bytes} [Fri Jul 15 16:25:45 2022] GET /identity/v3/endpoints?service_id=e7937bf4423546d6b3ce6fabe25a309f&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:45.502266 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9c1f5-cca6-4d5d-88b8-906d412f8b56 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:45.579334 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:45.587134 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5fe0a-8615-4dfa-abde-8548added547 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:45.620934 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9c1f5-cca6-4d5d-88b8-906d412f8b56 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:45.629674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764a2a7-f868-4201-908b-c05576a7aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:45.630344 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764a2a7-f868-4201-908b-c05576a7aa09 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:45.630629 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764a2a7-f868-4201-908b-c05576a7aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:45.631293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764a2a7-f868-4201-908b-c05576a7aa09 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:45.632021 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764a2a7-f868-4201-908b-c05576a7aa09 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:45.632711 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764a2a7-f868-4201-908b-c05576a7aa09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:45.634081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764a2a7-f868-4201-908b-c05576a7aa09 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:45.640378 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 351/700] 10.222.0.86 () {56 vars in 1124 bytes} [Fri Jul 15 16:25:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:45.641571 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ab32c-4199-4e6f-ae08-d013747c3529 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:45.642918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ab32c-4199-4e6f-ae08-d013747c3529 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:45.642918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ab32c-4199-4e6f-ae08-d013747c3529 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:45.643555 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 352/701] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:45.647131 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ab32c-4199-4e6f-ae08-d013747c3529 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:45.658562 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d09a8c-9e22-45a4-9327-79bcd8e3f74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:45.659505 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d09a8c-9e22-45a4-9327-79bcd8e3f74f None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:45.659949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d09a8c-9e22-45a4-9327-79bcd8e3f74f None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:45.660230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d09a8c-9e22-45a4-9327-79bcd8e3f74f None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:45.660968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d09a8c-9e22-45a4-9327-79bcd8e3f74f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:45.662291 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d09a8c-9e22-45a4-9327-79bcd8e3f74f None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:45.668529 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 350/702] 10.222.0.86 () {56 vars in 1087 bytes} [Fri Jul 15 16:25:45 2022] GET /identity/v3/services => generated 1002 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 16:25:45.669634 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3cfa0-0805-447f-b5e3-70d71c532d5d None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:45.669923 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3cfa0-0805-447f-b5e3-70d71c532d5d None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:45.670278 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3cfa0-0805-447f-b5e3-70d71c532d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:45.689341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-40e3cfa0-0805-447f-b5e3-70d71c532d5d None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:45.690643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-40e3cfa0-0805-447f-b5e3-70d71c532d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:45.701648 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:45.778889 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 351/703] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:45 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:25:45.799955 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ab32c-4199-4e6f-ae08-d013747c3529 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:45.803002 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3cfa0-0805-447f-b5e3-70d71c532d5d None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:45.854365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06201aea-bfd0-4ef3-9a29-398b65d78b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:45.854990 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06201aea-bfd0-4ef3-9a29-398b65d78b14 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:45.855277 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06201aea-bfd0-4ef3-9a29-398b65d78b14 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:45.855558 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06201aea-bfd0-4ef3-9a29-398b65d78b14 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:45.856310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06201aea-bfd0-4ef3-9a29-398b65d78b14 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:45.856618 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06201aea-bfd0-4ef3-9a29-398b65d78b14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:45.858132 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06201aea-bfd0-4ef3-9a29-398b65d78b14 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:45.868641 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 353/704] 10.222.0.86 () {56 vars in 1124 bytes} [Fri Jul 15 16:25:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:45.876453 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06201aea-bfd0-4ef3-9a29-398b65d78b14 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:45.886218 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:45.937063 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3cfa0-0805-447f-b5e3-70d71c532d5d None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:45.979718 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6a5d1-eb05-4eb0-95c9-249f261e4ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:45.981568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6a5d1-eb05-4eb0-95c9-249f261e4ccd None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:45.982003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6a5d1-eb05-4eb0-95c9-249f261e4ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:45.982437 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6a5d1-eb05-4eb0-95c9-249f261e4ccd None admin] PATH_INFO: `/v3/services/network` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:45.983266 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6a5d1-eb05-4eb0-95c9-249f261e4ccd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:45.985540 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6a5d1-eb05-4eb0-95c9-249f261e4ccd None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:45.997214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06201aea-bfd0-4ef3-9a29-398b65d78b14 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:45.999208 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-c7b6a5d1-eb05-4eb0-95c9-249f261e4ccd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:46.002299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:46.003520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:46.004447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:46.004447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:46.004447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:46.004447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:46.004447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:46.004447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:46.004447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:46.004447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:46.004447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:46.004447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:46.004447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:25:46.004447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:46.004447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 16:25:46.004447 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:46.007741 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 352/705] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:45 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:46.015096 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6a5d1-eb05-4eb0-95c9-249f261e4ccd None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:46.051303 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b835b-670a-4794-9616-5cce6f097764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:46.052719 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b835b-670a-4794-9616-5cce6f097764 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:46.053203 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b835b-670a-4794-9616-5cce6f097764 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:46.053708 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b835b-670a-4794-9616-5cce6f097764 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:46.054774 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b835b-670a-4794-9616-5cce6f097764 None admin] RBAC: Adding query filter params (interface=public, service_id=58cf137b757a4e87b06f997c63639e89, region_id=RegionOne) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:46.055329 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b835b-670a-4794-9616-5cce6f097764 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:46.056888 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b835b-670a-4794-9616-5cce6f097764 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:46.066303 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 354/706] 10.222.0.86 () {56 vars in 1251 bytes} [Fri Jul 15 16:25:45 2022] GET /identity/v3/endpoints?service_id=58cf137b757a4e87b06f997c63639e89&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:46.072059 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b835b-670a-4794-9616-5cce6f097764 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:46.151253 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6a5d1-eb05-4eb0-95c9-249f261e4ccd None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:46.183304 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:46.189964 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b835b-670a-4794-9616-5cce6f097764 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:46.203124 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f34e91-89bc-4aab-a505-2c717a9314db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:46.203805 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f34e91-89bc-4aab-a505-2c717a9314db None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:46.204091 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f34e91-89bc-4aab-a505-2c717a9314db None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:46.204377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f34e91-89bc-4aab-a505-2c717a9314db None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:46.205475 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f34e91-89bc-4aab-a505-2c717a9314db None admin] RBAC: Adding query filter params (name=network) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:46.205909 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f34e91-89bc-4aab-a505-2c717a9314db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:46.208852 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f34e91-89bc-4aab-a505-2c717a9314db None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:46.219018 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 353/707] 10.222.0.86 () {56 vars in 1112 bytes} [Fri Jul 15 16:25:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:46.223881 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f34e91-89bc-4aab-a505-2c717a9314db None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:46.235747 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca9bac-fffc-48c6-9357-1ab0994bf960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:46.236726 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca9bac-fffc-48c6-9357-1ab0994bf960 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:46.237215 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca9bac-fffc-48c6-9357-1ab0994bf960 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:46.237707 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca9bac-fffc-48c6-9357-1ab0994bf960 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:46.238578 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca9bac-fffc-48c6-9357-1ab0994bf960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:46.240237 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca9bac-fffc-48c6-9357-1ab0994bf960 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:46.251095 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 355/708] 10.222.0.86 () {56 vars in 1087 bytes} [Fri Jul 15 16:25:46 2022] GET /identity/v3/services => generated 1002 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 16:25:46.341590 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f34e91-89bc-4aab-a505-2c717a9314db None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:46.380139 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644449b5-b6a4-49a4-b548-d1419f9a163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:46.380828 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644449b5-b6a4-49a4-b548-d1419f9a163a None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:46.381116 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644449b5-b6a4-49a4-b548-d1419f9a163a None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:46.381397 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644449b5-b6a4-49a4-b548-d1419f9a163a None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:46.382119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644449b5-b6a4-49a4-b548-d1419f9a163a None admin] RBAC: Adding query filter params (type=network) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:46.382432 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644449b5-b6a4-49a4-b548-d1419f9a163a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:46.383861 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644449b5-b6a4-49a4-b548-d1419f9a163a None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:46.394627 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 354/709] 10.222.0.86 () {56 vars in 1112 bytes} [Fri Jul 15 16:25:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:46.396042 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca9bac-fffc-48c6-9357-1ab0994bf960 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:46.428033 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:46.509361 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca9bac-fffc-48c6-9357-1ab0994bf960 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:46.544734 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e12ec-cc4a-49ce-a4f2-57ba67f43ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:46.545391 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e12ec-cc4a-49ce-a4f2-57ba67f43ec2 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:46.545674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e12ec-cc4a-49ce-a4f2-57ba67f43ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:46.545947 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e12ec-cc4a-49ce-a4f2-57ba67f43ec2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:46.546738 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e12ec-cc4a-49ce-a4f2-57ba67f43ec2 None admin] RBAC: Adding query filter params (interface=public, service_id=0902cf656463469ebbf8b7e4550195fd, region_id=RegionOne) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:46.547120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e12ec-cc4a-49ce-a4f2-57ba67f43ec2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:46.548553 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e12ec-cc4a-49ce-a4f2-57ba67f43ec2 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:46.558439 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 356/710] 10.222.0.86 () {56 vars in 1251 bytes} [Fri Jul 15 16:25:46 2022] GET /identity/v3/endpoints?service_id=0902cf656463469ebbf8b7e4550195fd&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:46.560422 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644449b5-b6a4-49a4-b548-d1419f9a163a None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:46.616470 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:46.667065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644449b5-b6a4-49a4-b548-d1419f9a163a None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:46.702138 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5693d06-29db-45b5-98cc-c2111d72aa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:46.702734 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5693d06-29db-45b5-98cc-c2111d72aa58 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:46.703056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5693d06-29db-45b5-98cc-c2111d72aa58 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:46.703337 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5693d06-29db-45b5-98cc-c2111d72aa58 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:46.704019 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5693d06-29db-45b5-98cc-c2111d72aa58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:46.705387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5693d06-29db-45b5-98cc-c2111d72aa58 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:46.715831 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 355/711] 10.222.0.86 () {56 vars in 1087 bytes} [Fri Jul 15 16:25:46 2022] GET /identity/v3/services => generated 1002 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 16:25:47.610881 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29c1f1-825a-49fd-857b-2f24dbb133c9 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:47.611433 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29c1f1-825a-49fd-857b-2f24dbb133c9 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:47.611433 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29c1f1-825a-49fd-857b-2f24dbb133c9 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:47.613070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 357/712] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:47.618275 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974ae11-8969-4770-8dfc-3cf807aa9ba1 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:47.618663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974ae11-8969-4770-8dfc-3cf807aa9ba1 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:47.618847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974ae11-8969-4770-8dfc-3cf807aa9ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:47.636054 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-b974ae11-8969-4770-8dfc-3cf807aa9ba1 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:47.637289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-b974ae11-8969-4770-8dfc-3cf807aa9ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:47.706423 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 356/713] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:47 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:25:47.730596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29c1f1-825a-49fd-857b-2f24dbb133c9 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:47.831649 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:47.844224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29c1f1-825a-49fd-857b-2f24dbb133c9 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:47.880662 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776381f-3ce1-4e8a-b997-66ed4605658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:47.881461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776381f-3ce1-4e8a-b997-66ed4605658d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:47.881744 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776381f-3ce1-4e8a-b997-66ed4605658d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:47.882022 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776381f-3ce1-4e8a-b997-66ed4605658d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:47.893264 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776381f-3ce1-4e8a-b997-66ed4605658d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-5776381f-3ce1-4e8a-b997-66ed4605658d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:25:47.900870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:47.901827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:47.903912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:47.903912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:47.903912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:47.903912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:47.903912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:25:47.903912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:25:47.903912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:25:47.903912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:25:47.903912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:25:47.903912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:25:47.903912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:25:47.903912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:47.903912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 358/714] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:25:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:47.911026 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974ae11-8969-4770-8dfc-3cf807aa9ba1 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:47.960852 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:47.971185 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2e234-c3df-49d6-be08-def59963995b None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:47.971479 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2e234-c3df-49d6-be08-def59963995b None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:47.971738 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2e234-c3df-49d6-be08-def59963995b None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:47.973412 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 359/715] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:47.978214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22e47e-d5bf-43b1-b78f-fb33e4f409aa None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:47.978520 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22e47e-d5bf-43b1-b78f-fb33e4f409aa None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:47.978801 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22e47e-d5bf-43b1-b78f-fb33e4f409aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:47.995401 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-3e22e47e-d5bf-43b1-b78f-fb33e4f409aa None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:47.996741 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-3e22e47e-d5bf-43b1-b78f-fb33e4f409aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:48.031160 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974ae11-8969-4770-8dfc-3cf807aa9ba1 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:48.075490 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 360/716] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:47 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 16:25:48.076366 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4c51-8fb2-42b8-84a7-089a291eb77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:48.077250 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4c51-8fb2-42b8-84a7-089a291eb77f None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:48.077771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4c51-8fb2-42b8-84a7-089a291eb77f None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:48.078235 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4c51-8fb2-42b8-84a7-089a291eb77f None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:48.079286 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd4c51-8fb2-42b8-84a7-089a291eb77f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:48.079771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd4c51-8fb2-42b8-84a7-089a291eb77f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:48.081358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd4c51-8fb2-42b8-84a7-089a291eb77f None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:48.091669 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 357/717] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:25:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:48.096235 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22e47e-d5bf-43b1-b78f-fb33e4f409aa None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:48.099910 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4c51-8fb2-42b8-84a7-089a291eb77f None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:48.193500 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:48.209727 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4c51-8fb2-42b8-84a7-089a291eb77f None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:48.215229 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22e47e-d5bf-43b1-b78f-fb33e4f409aa None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:48.220386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:48.246426 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e0c9f-6103-4d4c-9dc9-db97d6fb1f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:48.247735 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0c9f-6103-4d4c-9dc9-db97d6fb1f75 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:48.248020 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0c9f-6103-4d4c-9dc9-db97d6fb1f75 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:48.248298 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0c9f-6103-4d4c-9dc9-db97d6fb1f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:48.254769 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f24525-1e5f-4492-a62d-e91fa2fe7adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:48.255940 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f24525-1e5f-4492-a62d-e91fa2fe7adf None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:48.256420 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f24525-1e5f-4492-a62d-e91fa2fe7adf None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:48.256900 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f24525-1e5f-4492-a62d-e91fa2fe7adf None admin] PATH_INFO: `/v3/services/image` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:48.257861 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f24525-1e5f-4492-a62d-e91fa2fe7adf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:48.259455 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e0c9f-6103-4d4c-9dc9-db97d6fb1f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:48.259705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f24525-1e5f-4492-a62d-e91fa2fe7adf None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:48.260952 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e0c9f-6103-4d4c-9dc9-db97d6fb1f75 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-82f24525-1e5f-4492-a62d-e91fa2fe7adf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:48.273124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:48.274139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:48.275106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:48.275106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:48.275106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:48.275106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:48.275106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:48.275106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:48.275106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:48.275106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:48.275106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:48.275106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:48.275106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:25:48.275106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:48.275106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 16:25:48.275106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:48.277937 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 361/718] 10.222.0.86 () {56 vars in 1105 bytes} [Fri Jul 15 16:25:48 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:48.283488 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f24525-1e5f-4492-a62d-e91fa2fe7adf None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:48.283626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-473e0c9f-6103-4d4c-9dc9-db97d6fb1f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:48.283626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:48.283626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:48.283626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:48.283626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:48.283626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:48.283626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:48.283626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:48.283626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:48.283626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:48.283626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:48.283626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:48.283626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:48.283626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:48.283626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:48.284467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:48.285369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:48.285369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:48.285369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:48.285369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:48.285369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 358/719] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:48.290052 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e0c9f-6103-4d4c-9dc9-db97d6fb1f75 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:48.404291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f24525-1e5f-4492-a62d-e91fa2fe7adf None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:48.419527 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e0c9f-6103-4d4c-9dc9-db97d6fb1f75 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:48.441232 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2409c7-1456-4e6b-91dd-4e74d285c286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:48.441979 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2409c7-1456-4e6b-91dd-4e74d285c286 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:48.442182 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2409c7-1456-4e6b-91dd-4e74d285c286 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:48.442461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2409c7-1456-4e6b-91dd-4e74d285c286 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:48.443211 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2409c7-1456-4e6b-91dd-4e74d285c286 None admin] RBAC: Adding query filter params (name=image) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:48.443582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2409c7-1456-4e6b-91dd-4e74d285c286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:48.444898 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2409c7-1456-4e6b-91dd-4e74d285c286 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:48.455233 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 362/720] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:48.456237 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2409c7-1456-4e6b-91dd-4e74d285c286 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:48.464837 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ec5d0-27d3-45e6-a3b0-eb26e4909bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:48.465908 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ec5d0-27d3-45e6-a3b0-eb26e4909bd5 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:48.466397 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ec5d0-27d3-45e6-a3b0-eb26e4909bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:48.466928 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ec5d0-27d3-45e6-a3b0-eb26e4909bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:48.467857 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ec5d0-27d3-45e6-a3b0-eb26e4909bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:48.468506 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ec5d0-27d3-45e6-a3b0-eb26e4909bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:48.470147 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ec5d0-27d3-45e6-a3b0-eb26e4909bd5 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:48.470451 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:48.485191 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 359/721] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:48.492551 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ec5d0-27d3-45e6-a3b0-eb26e4909bd5 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:48.525382 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:48.584403 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2409c7-1456-4e6b-91dd-4e74d285c286 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:48.616595 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ec5d0-27d3-45e6-a3b0-eb26e4909bd5 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:48.621047 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cb0cf-9276-4d2b-9066-0a3e48bf3d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:48.622830 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cb0cf-9276-4d2b-9066-0a3e48bf3d05 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:48.623501 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cb0cf-9276-4d2b-9066-0a3e48bf3d05 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:48.623997 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cb0cf-9276-4d2b-9066-0a3e48bf3d05 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:48.624908 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cb0cf-9276-4d2b-9066-0a3e48bf3d05 None admin] RBAC: Adding query filter params (type=image) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:48.625415 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cb0cf-9276-4d2b-9066-0a3e48bf3d05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:48.627003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cb0cf-9276-4d2b-9066-0a3e48bf3d05 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:48.637245 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 363/722] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:48.638448 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cb0cf-9276-4d2b-9066-0a3e48bf3d05 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:48.654001 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a1daf-fcbc-48dc-9783-8020901e4c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:48.655024 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1daf-fcbc-48dc-9783-8020901e4c7e None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:48.655320 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1daf-fcbc-48dc-9783-8020901e4c7e None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:48.655603 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1daf-fcbc-48dc-9783-8020901e4c7e None admin] PATH_INFO: `/v3/users/nova` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:48.663267 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a1daf-fcbc-48dc-9783-8020901e4c7e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:48.664722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a1daf-fcbc-48dc-9783-8020901e4c7e None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-2e2a1daf-fcbc-48dc-9783-8020901e4c7e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:25:48.680644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:48.681819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:48.682981 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:48.682981 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:48.682981 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:25:48.682981 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:25:48.682981 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:25:48.682981 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:25:48.682981 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:25:48.682981 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:25:48.682981 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 16:25:48.682981 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:48.687120 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 360/723] 10.222.0.86 () {56 vars in 1093 bytes} [Fri Jul 15 16:25:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:48.688377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e58601-37b6-43e3-baf7-05f279d2481c None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:48.688672 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e58601-37b6-43e3-baf7-05f279d2481c None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:48.688951 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e58601-37b6-43e3-baf7-05f279d2481c None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:48.690237 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 361/724] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:48.691072 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e58601-37b6-43e3-baf7-05f279d2481c None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:48.732064 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:48.760546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cb0cf-9276-4d2b-9066-0a3e48bf3d05 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:48.783628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:48.797094 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc76d07-1da8-49c3-a01e-26cffaa955f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:48.797753 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc76d07-1da8-49c3-a01e-26cffaa955f1 None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:48.798152 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc76d07-1da8-49c3-a01e-26cffaa955f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:48.798428 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc76d07-1da8-49c3-a01e-26cffaa955f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:48.799314 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc76d07-1da8-49c3-a01e-26cffaa955f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:48.800671 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc76d07-1da8-49c3-a01e-26cffaa955f1 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:48.805238 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e58601-37b6-43e3-baf7-05f279d2481c None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:48.821640 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 364/725] 10.222.0.86 () {60 vars in 1144 bytes} [Fri Jul 15 16:25:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:25:48.822949 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a80be3-a73b-462f-99e7-c269f4a34c94 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:48.823245 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a80be3-a73b-462f-99e7-c269f4a34c94 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:48.823530 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a80be3-a73b-462f-99e7-c269f4a34c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:48.847101 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-b1a80be3-a73b-462f-99e7-c269f4a34c94 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:48.848699 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-b1a80be3-a73b-462f-99e7-c269f4a34c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:48.862991 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388d553-a125-430b-a847-e38bb063fae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:48.864017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388d553-a125-430b-a847-e38bb063fae7 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:48.864452 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388d553-a125-430b-a847-e38bb063fae7 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:48.864867 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388d553-a125-430b-a847-e38bb063fae7 None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:48.865901 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388d553-a125-430b-a847-e38bb063fae7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:48.866410 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388d553-a125-430b-a847-e38bb063fae7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:48.868127 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388d553-a125-430b-a847-e38bb063fae7 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:48.889723 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 362/726] 10.222.0.86 () {56 vars in 1133 bytes} [Fri Jul 15 16:25:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:48.895347 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388d553-a125-430b-a847-e38bb063fae7 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:48.941023 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 365/727] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:48 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:25:48.965179 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a80be3-a73b-462f-99e7-c269f4a34c94 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:49.026590 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388d553-a125-430b-a847-e38bb063fae7 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:49.060903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:49.068172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c3964-a79b-4b9e-9ce0-cd4ce82eb9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:49.068873 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c3964-a79b-4b9e-9ce0-cd4ce82eb9de None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:49.069105 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c3964-a79b-4b9e-9ce0-cd4ce82eb9de None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:49.069380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c3964-a79b-4b9e-9ce0-cd4ce82eb9de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:49.073392 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:49.121250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a80be3-a73b-462f-99e7-c269f4a34c94 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:49.151028 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c3964-a79b-4b9e-9ce0-cd4ce82eb9de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:49.152483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c3964-a79b-4b9e-9ce0-cd4ce82eb9de None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:49.157964 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a796fe5-732c-4bc3-b5ca-2325a20cd2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:49.159046 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a796fe5-732c-4bc3-b5ca-2325a20cd2a4 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:49.159572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a796fe5-732c-4bc3-b5ca-2325a20cd2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:49.160059 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a796fe5-732c-4bc3-b5ca-2325a20cd2a4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:49.161084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a796fe5-732c-4bc3-b5ca-2325a20cd2a4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:49.162735 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a796fe5-732c-4bc3-b5ca-2325a20cd2a4 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-9a796fe5-732c-4bc3-b5ca-2325a20cd2a4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:49.176644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:49.177754 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:49.178772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:49.178772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:49.178772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:49.178772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:49.178772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:49.178772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:49.178772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:49.178772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:49.178772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:49.178772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:49.178772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:49.178772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:25:49.178772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:49.178772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 16:25:49.178772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:49.181657 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 366/728] 10.222.0.86 () {56 vars in 1129 bytes} [Fri Jul 15 16:25:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:49.182979 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3159a1-4672-4712-9970-71268f18c479 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:49.183267 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3159a1-4672-4712-9970-71268f18c479 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:49.183542 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3159a1-4672-4712-9970-71268f18c479 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:49.186909 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 367/729] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:49.187056 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3159a1-4672-4712-9970-71268f18c479 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:49.263503 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 363/730] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:48 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 16:25:49.264793 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a64583-7536-49d5-bc16-8b8a5988ec5e None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:49.265094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a64583-7536-49d5-bc16-8b8a5988ec5e None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:49.265377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a64583-7536-49d5-bc16-8b8a5988ec5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:49.283986 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-03a64583-7536-49d5-bc16-8b8a5988ec5e None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:49.285090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-03a64583-7536-49d5-bc16-8b8a5988ec5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:49.293132 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3159a1-4672-4712-9970-71268f18c479 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:49.313965 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:49.317777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:49.329913 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf0145-9828-42a7-8693-069e925859e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:49.330585 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf0145-9828-42a7-8693-069e925859e9 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:49.330889 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf0145-9828-42a7-8693-069e925859e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:49.331171 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf0145-9828-42a7-8693-069e925859e9 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:49.331882 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf0145-9828-42a7-8693-069e925859e9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:49.332196 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf0145-9828-42a7-8693-069e925859e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:49.333553 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf0145-9828-42a7-8693-069e925859e9 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:49.343174 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 368/731] 10.222.0.86 () {56 vars in 1124 bytes} [Fri Jul 15 16:25:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:25:49.343174 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf0145-9828-42a7-8693-069e925859e9 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:49.364614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 364/732] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:49 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:25:49.365395 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a64583-7536-49d5-bc16-8b8a5988ec5e None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:49.463786 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf0145-9828-42a7-8693-069e925859e9 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:49.475948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a64583-7536-49d5-bc16-8b8a5988ec5e None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:49.499511 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac268985-9ae8-4fa0-8c81-8597cb18e43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:49.500299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac268985-9ae8-4fa0-8c81-8597cb18e43e None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:49.500584 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac268985-9ae8-4fa0-8c81-8597cb18e43e None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:49.500866 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac268985-9ae8-4fa0-8c81-8597cb18e43e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:49.512673 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac268985-9ae8-4fa0-8c81-8597cb18e43e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:49.513345 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0534020-c8aa-4af5-aadf-f3978c681122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:49.514009 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0534020-c8aa-4af5-aadf-f3978c681122 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:49.514178 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac268985-9ae8-4fa0-8c81-8597cb18e43e None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:49.514288 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0534020-c8aa-4af5-aadf-f3978c681122 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:49.514555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0534020-c8aa-4af5-aadf-f3978c681122 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:49.515272 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0534020-c8aa-4af5-aadf-f3978c681122 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:49.515579 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0534020-c8aa-4af5-aadf-f3978c681122 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:49.517406 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0534020-c8aa-4af5-aadf-f3978c681122 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:49.527663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 365/733] 10.222.0.86 () {56 vars in 1124 bytes} [Fri Jul 15 16:25:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:49.527663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0534020-c8aa-4af5-aadf-f3978c681122 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:49.531762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-ac268985-9ae8-4fa0-8c81-8597cb18e43e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:49.531762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:49.531762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:49.531762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:49.531762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:49.531762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:49.531762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:49.531762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:49.531762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:49.531762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:49.531762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:49.531762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:49.531762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:49.531762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:49.531762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:49.532690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:49.533592 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:49.533592 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:49.533592 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:49.533592 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:49.533592 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 369/734] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:49.533885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac268985-9ae8-4fa0-8c81-8597cb18e43e None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:49.561746 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:49.586416 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:49.646294 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0534020-c8aa-4af5-aadf-f3978c681122 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:49.661409 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac268985-9ae8-4fa0-8c81-8597cb18e43e None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:49.683343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67811fa3-ecd4-47b3-85a7-8f34adb18504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:49.684808 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67811fa3-ecd4-47b3-85a7-8f34adb18504 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:49.685164 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67811fa3-ecd4-47b3-85a7-8f34adb18504 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:49.685520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67811fa3-ecd4-47b3-85a7-8f34adb18504 None admin] PATH_INFO: `/v3/services/network` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:49.686260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67811fa3-ecd4-47b3-85a7-8f34adb18504 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:49.687731 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67811fa3-ecd4-47b3-85a7-8f34adb18504 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:49.696266 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1accca-e3b7-4524-9c2e-0e52fcbc69fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:49.697084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1accca-e3b7-4524-9c2e-0e52fcbc69fc None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:49.697509 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1accca-e3b7-4524-9c2e-0e52fcbc69fc None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:49.698031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1accca-e3b7-4524-9c2e-0e52fcbc69fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:49.698963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1accca-e3b7-4524-9c2e-0e52fcbc69fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-67811fa3-ecd4-47b3-85a7-8f34adb18504 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:49.700588 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:49.701744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:49.702561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:49.702561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:49.702561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:49.702561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:49.702561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:49.702561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:49.702561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:49.702561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:49.702561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:49.702561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:49.702561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:25:49.702561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:49.702561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 16:25:49.702561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:49.702561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 366/735] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:49 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:49.703376 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67811fa3-ecd4-47b3-85a7-8f34adb18504 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:49.704208 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1accca-e3b7-4524-9c2e-0e52fcbc69fc None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:49.728337 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 370/736] 10.222.0.86 () {60 vars in 1144 bytes} [Fri Jul 15 16:25:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:25:49.729666 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1accca-e3b7-4524-9c2e-0e52fcbc69fc None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:49.810589 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:49.820557 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67811fa3-ecd4-47b3-85a7-8f34adb18504 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:49.873793 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb43c0-7243-4dd8-9312-385fe96c6835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:49.874583 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb43c0-7243-4dd8-9312-385fe96c6835 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:49.874985 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb43c0-7243-4dd8-9312-385fe96c6835 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:49.875328 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb43c0-7243-4dd8-9312-385fe96c6835 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:49.876284 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb43c0-7243-4dd8-9312-385fe96c6835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:49.876664 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb43c0-7243-4dd8-9312-385fe96c6835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:49.878173 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb43c0-7243-4dd8-9312-385fe96c6835 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:49.897872 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 367/737] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:49.899948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb43c0-7243-4dd8-9312-385fe96c6835 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:50.003678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:50.012666 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1accca-e3b7-4524-9c2e-0e52fcbc69fc None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:50.030465 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb43c0-7243-4dd8-9312-385fe96c6835 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:50.050231 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622d491-bb44-4054-96be-e9d631284262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:50.051066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622d491-bb44-4054-96be-e9d631284262 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:50.051658 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622d491-bb44-4054-96be-e9d631284262 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:50.051777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622d491-bb44-4054-96be-e9d631284262 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:50.052583 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622d491-bb44-4054-96be-e9d631284262 None admin] RBAC: Adding query filter params (name=network) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:50.052988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622d491-bb44-4054-96be-e9d631284262 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:50.054446 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622d491-bb44-4054-96be-e9d631284262 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:50.059689 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 371/738] 10.222.0.86 () {56 vars in 1112 bytes} [Fri Jul 15 16:25:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:50.065140 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622d491-bb44-4054-96be-e9d631284262 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:50.071656 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256e96d-0748-4122-b4de-5303dd1da57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:50.072759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256e96d-0748-4122-b4de-5303dd1da57e None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:50.073204 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256e96d-0748-4122-b4de-5303dd1da57e None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:50.073626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256e96d-0748-4122-b4de-5303dd1da57e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:50.082789 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256e96d-0748-4122-b4de-5303dd1da57e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:50.084314 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256e96d-0748-4122-b4de-5303dd1da57e None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:50.100622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-d256e96d-0748-4122-b4de-5303dd1da57e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:50.100622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:50.100622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:50.100622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:50.100622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:50.100622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:50.100622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:50.100622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:50.100622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:50.100622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:50.100622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:50.100622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:50.100622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:25:50.100622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:25:50.100622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:50.101580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:50.102459 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:25:50.102459 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:25:50.102459 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:25:50.102459 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:25:50.102459 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:25:50.102459 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:25:50.102459 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:25:50.102459 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:50.107502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 368/739] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:25:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:50.108938 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256e96d-0748-4122-b4de-5303dd1da57e None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:50.124938 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:50.177306 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622d491-bb44-4054-96be-e9d631284262 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:50.214387 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49558087-a980-4e56-80a1-7b131155b428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:50.215183 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49558087-a980-4e56-80a1-7b131155b428 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:50.216113 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49558087-a980-4e56-80a1-7b131155b428 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:50.216395 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49558087-a980-4e56-80a1-7b131155b428 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:50.217209 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49558087-a980-4e56-80a1-7b131155b428 None admin] RBAC: Adding query filter params (type=network) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:50.217519 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49558087-a980-4e56-80a1-7b131155b428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:50.219145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49558087-a980-4e56-80a1-7b131155b428 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:50.224647 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 372/740] 10.222.0.86 () {56 vars in 1112 bytes} [Fri Jul 15 16:25:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:50.228304 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256e96d-0748-4122-b4de-5303dd1da57e None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:50.231895 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49558087-a980-4e56-80a1-7b131155b428 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:50.258902 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:50.268003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eeb32-ea89-4d0a-be28-b4a715e62434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:50.268676 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eeb32-ea89-4d0a-be28-b4a715e62434 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:50.268966 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eeb32-ea89-4d0a-be28-b4a715e62434 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:50.269243 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eeb32-ea89-4d0a-be28-b4a715e62434 None admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:50.270031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6eeb32-ea89-4d0a-be28-b4a715e62434 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:50.270345 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6eeb32-ea89-4d0a-be28-b4a715e62434 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:50.272627 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6eeb32-ea89-4d0a-be28-b4a715e62434 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:50.290547 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 369/741] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:50.291980 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eeb32-ea89-4d0a-be28-b4a715e62434 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:50.349018 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49558087-a980-4e56-80a1-7b131155b428 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:50.371319 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:50.386032 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f4b17-e2bb-4ef1-a91a-b16d13529d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:50.386778 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f4b17-e2bb-4ef1-a91a-b16d13529d62 None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:50.387205 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f4b17-e2bb-4ef1-a91a-b16d13529d62 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:50.387708 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f4b17-e2bb-4ef1-a91a-b16d13529d62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:50.388404 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f4b17-e2bb-4ef1-a91a-b16d13529d62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:50.389851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f4b17-e2bb-4ef1-a91a-b16d13529d62 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:50.418989 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 373/742] 10.222.0.86 () {60 vars in 1144 bytes} [Fri Jul 15 16:25:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:25:50.419218 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eeb32-ea89-4d0a-be28-b4a715e62434 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:50.463048 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42361b5-aa32-4fa6-bb36-68a9c6109b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:50.463716 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42361b5-aa32-4fa6-bb36-68a9c6109b2e None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:50.464007 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42361b5-aa32-4fa6-bb36-68a9c6109b2e None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:50.464340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42361b5-aa32-4fa6-bb36-68a9c6109b2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:50.465180 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42361b5-aa32-4fa6-bb36-68a9c6109b2e None admin] RBAC: Adding query filter params (role.id=923dd61feaca45d0933a4601fb2c065b, scope.project.id=db599cc43051468cbf306faba2431b23, user.id=f34916bd4d56411e8994d1c476885e2e) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:50.466121 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42361b5-aa32-4fa6-bb36-68a9c6109b2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:50.467620 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42361b5-aa32-4fa6-bb36-68a9c6109b2e None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:50.479049 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 370/743] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:25:50 2022] GET /identity/v3/role_assignments?user.id=f34916bd4d56411e8994d1c476885e2e&scope.project.id=db599cc43051468cbf306faba2431b23&role.id=923dd61feaca45d0933a4601fb2c065b => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:51.222208 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f231c8-c20f-4a71-9b36-29c221ff907b None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:51.222764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f231c8-c20f-4a71-9b36-29c221ff907b None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:51.222764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f231c8-c20f-4a71-9b36-29c221ff907b None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:51.224332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 374/744] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:51.229272 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82e66-c655-468b-8cf0-e9df6e1bd0b6 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:51.229658 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82e66-c655-468b-8cf0-e9df6e1bd0b6 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:51.229839 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82e66-c655-468b-8cf0-e9df6e1bd0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:51.249416 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-24f82e66-c655-468b-8cf0-e9df6e1bd0b6 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:51.250616 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-24f82e66-c655-468b-8cf0-e9df6e1bd0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:51.319595 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 371/745] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:51 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:25:51.343717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f231c8-c20f-4a71-9b36-29c221ff907b None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:51.426141 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:51.447948 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f231c8-c20f-4a71-9b36-29c221ff907b None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:51.482759 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399524c-b6e1-4184-a98a-26db8e9aeace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:51.483361 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399524c-b6e1-4184-a98a-26db8e9aeace None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:51.483648 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399524c-b6e1-4184-a98a-26db8e9aeace None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:51.483927 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399524c-b6e1-4184-a98a-26db8e9aeace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:51.552351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399524c-b6e1-4184-a98a-26db8e9aeace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:51.553832 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399524c-b6e1-4184-a98a-26db8e9aeace None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:51.634333 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:51.656414 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 375/746] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:25:51 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 16:25:51.661906 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f82e66-c655-468b-8cf0-e9df6e1bd0b6 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:51.723082 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:51.766775 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f82e66-c655-468b-8cf0-e9df6e1bd0b6 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:51.801137 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6565192-ff25-485a-87b9-aa2fa4a32279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:51.801930 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6565192-ff25-485a-87b9-aa2fa4a32279 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:51.802215 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6565192-ff25-485a-87b9-aa2fa4a32279 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:51.802491 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6565192-ff25-485a-87b9-aa2fa4a32279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:51.813183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6565192-ff25-485a-87b9-aa2fa4a32279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:51.814625 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6565192-ff25-485a-87b9-aa2fa4a32279 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:51.832801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-c6565192-ff25-485a-87b9-aa2fa4a32279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:51.832801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:51.832801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:51.832801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:51.832801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:51.832801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:51.832801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:51.832801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:51.832801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:51.832801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:51.832801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:51.832801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:51.832801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:25:51.832801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:25:51.832801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:51.833678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:51.834573 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:25:51.834573 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:25:51.834573 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:25:51.834573 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:51.838919 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 372/747] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:51.839998 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399524c-b6e1-4184-a98a-26db8e9aeace None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:51.979646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399524c-b6e1-4184-a98a-26db8e9aeace None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:52.009593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51712f07-d0f1-4904-8f9d-3de03e9a2fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:52.010266 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51712f07-d0f1-4904-8f9d-3de03e9a2fc2 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:52.010550 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51712f07-d0f1-4904-8f9d-3de03e9a2fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:52.010828 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51712f07-d0f1-4904-8f9d-3de03e9a2fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:52.011585 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51712f07-d0f1-4904-8f9d-3de03e9a2fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:52.011893 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51712f07-d0f1-4904-8f9d-3de03e9a2fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:52.013823 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51712f07-d0f1-4904-8f9d-3de03e9a2fc2 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:52.034990 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 376/748] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:52.083638 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447c8ea-3072-4a46-9afa-00943cf276c7 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:52.083638 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447c8ea-3072-4a46-9afa-00943cf276c7 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:52.083638 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447c8ea-3072-4a46-9afa-00943cf276c7 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:52.086848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 373/749] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:52.091199 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dc17a-f13a-4e6e-aed0-a5befee92c29 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:52.092104 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dc17a-f13a-4e6e-aed0-a5befee92c29 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:52.092104 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dc17a-f13a-4e6e-aed0-a5befee92c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:52.112861 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-9b7dc17a-f13a-4e6e-aed0-a5befee92c29 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:52.114072 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-9b7dc17a-f13a-4e6e-aed0-a5befee92c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:52.151747 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:52.193638 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 377/750] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:52 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:25:52.217550 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447c8ea-3072-4a46-9afa-00943cf276c7 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:52.327564 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447c8ea-3072-4a46-9afa-00943cf276c7 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:52.338816 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:52.365494 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1efbdf-e5cb-4aea-98f5-0aaeaccd0046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:52.366294 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1efbdf-e5cb-4aea-98f5-0aaeaccd0046 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:52.366576 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1efbdf-e5cb-4aea-98f5-0aaeaccd0046 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:52.366850 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1efbdf-e5cb-4aea-98f5-0aaeaccd0046 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:52.367530 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1efbdf-e5cb-4aea-98f5-0aaeaccd0046 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:52.368905 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1efbdf-e5cb-4aea-98f5-0aaeaccd0046 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-2b1efbdf-e5cb-4aea-98f5-0aaeaccd0046 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:52.380848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:52.382040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:52.383438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:52.383438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:52.383438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:52.383438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:52.383438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:52.383438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:52.383438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:52.383438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:52.383438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:52.383438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:52.383438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:25:52.383438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:52.383438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 16:25:52.383438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:52.383438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 374/751] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:25:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:52.388435 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dc17a-f13a-4e6e-aed0-a5befee92c29 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:52.484611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dc17a-f13a-4e6e-aed0-a5befee92c29 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:52.518802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7eaea-9397-460f-8fee-7e324469eb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:52.519490 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7eaea-9397-460f-8fee-7e324469eb3d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:52.519773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7eaea-9397-460f-8fee-7e324469eb3d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:52.520049 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7eaea-9397-460f-8fee-7e324469eb3d None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:52.520757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7eaea-9397-460f-8fee-7e324469eb3d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:52.521063 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7eaea-9397-460f-8fee-7e324469eb3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:52.522420 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7eaea-9397-460f-8fee-7e324469eb3d None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:52.526934 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 378/752] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:25:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:52.533169 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1efbdf-e5cb-4aea-98f5-0aaeaccd0046 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:52.630387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1efbdf-e5cb-4aea-98f5-0aaeaccd0046 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:52.665227 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5b09a-0aa5-4a8e-b49f-6ea7f767aef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:52.665905 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5b09a-0aa5-4a8e-b49f-6ea7f767aef5 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:52.666187 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5b09a-0aa5-4a8e-b49f-6ea7f767aef5 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:52.666459 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5b09a-0aa5-4a8e-b49f-6ea7f767aef5 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:52.667335 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5b09a-0aa5-4a8e-b49f-6ea7f767aef5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:52.667545 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5b09a-0aa5-4a8e-b49f-6ea7f767aef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:52.669580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5b09a-0aa5-4a8e-b49f-6ea7f767aef5 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:52.674682 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 375/753] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:25:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:52.806708 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa2ff3-1888-420c-89e8-1103b2615bb5 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:52.807065 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa2ff3-1888-420c-89e8-1103b2615bb5 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:52.807291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa2ff3-1888-420c-89e8-1103b2615bb5 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:52.808677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 379/754] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:52.814304 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f48c5-3e8c-4ff2-8923-d7dd1b9dd97c None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:52.814599 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f48c5-3e8c-4ff2-8923-d7dd1b9dd97c None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:52.814914 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f48c5-3e8c-4ff2-8923-d7dd1b9dd97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:52.832472 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-689f48c5-3e8c-4ff2-8923-d7dd1b9dd97c None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:52.833668 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-689f48c5-3e8c-4ff2-8923-d7dd1b9dd97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:52.869572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:52.906880 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 376/755] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:52 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:25:52.929584 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa2ff3-1888-420c-89e8-1103b2615bb5 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:52.963581 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:53.030105 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa2ff3-1888-420c-89e8-1103b2615bb5 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:53.072084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2303a-03a3-4d3c-8f95-915a6b52e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:53.072883 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2303a-03a3-4d3c-8f95-915a6b52e674 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:53.073168 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2303a-03a3-4d3c-8f95-915a6b52e674 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:53.073445 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2303a-03a3-4d3c-8f95-915a6b52e674 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:53.074094 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2303a-03a3-4d3c-8f95-915a6b52e674 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:53.076242 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2303a-03a3-4d3c-8f95-915a6b52e674 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-8ab2303a-03a3-4d3c-8f95-915a6b52e674 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:53.088169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:53.089120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:53.089946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:53.089946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:53.089946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:53.089946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:53.089946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:53.089946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:53.089946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:53.089946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:53.089946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:53.089946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:53.089946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:53.089946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:25:53.089946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:53.089946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 16:25:53.089946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:25:53.091939 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 380/756] 10.222.0.86 () {56 vars in 1132 bytes} [Fri Jul 15 16:25:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:53.095708 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f48c5-3e8c-4ff2-8923-d7dd1b9dd97c None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:53.196778 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f48c5-3e8c-4ff2-8923-d7dd1b9dd97c None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:53.231051 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253b1ad-0bec-4ce3-bae1-1d2e5954181d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:53.231831 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253b1ad-0bec-4ce3-bae1-1d2e5954181d None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:53.232124 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253b1ad-0bec-4ce3-bae1-1d2e5954181d None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:53.232490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253b1ad-0bec-4ce3-bae1-1d2e5954181d None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:53.233197 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253b1ad-0bec-4ce3-bae1-1d2e5954181d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:53.233508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253b1ad-0bec-4ce3-bae1-1d2e5954181d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:53.234902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253b1ad-0bec-4ce3-bae1-1d2e5954181d None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:53.239508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 377/757] 10.222.0.86 () {56 vars in 1126 bytes} [Fri Jul 15 16:25:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:53.245181 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2303a-03a3-4d3c-8f95-915a6b52e674 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:53.340103 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:53.344952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2303a-03a3-4d3c-8f95-915a6b52e674 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:53.377745 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0881631-e49c-4b9b-b3b3-9c63ca3ec286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:53.378399 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0881631-e49c-4b9b-b3b3-9c63ca3ec286 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:53.378683 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0881631-e49c-4b9b-b3b3-9c63ca3ec286 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:53.378995 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0881631-e49c-4b9b-b3b3-9c63ca3ec286 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:53.379696 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0881631-e49c-4b9b-b3b3-9c63ca3ec286 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:53.380005 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0881631-e49c-4b9b-b3b3-9c63ca3ec286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:53.381359 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0881631-e49c-4b9b-b3b3-9c63ca3ec286 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:53.385725 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 381/758] 10.222.0.86 () {56 vars in 1126 bytes} [Fri Jul 15 16:25:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:54.873552 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acc9a0-3492-44e2-8b57-bf478da790ac None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:54.873988 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acc9a0-3492-44e2-8b57-bf478da790ac None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:54.874120 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acc9a0-3492-44e2-8b57-bf478da790ac None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:54.875520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 378/759] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:54.880723 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa816c-6f30-4e5d-9973-9cfd23a6fb04 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:54.881118 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa816c-6f30-4e5d-9973-9cfd23a6fb04 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:54.881282 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa816c-6f30-4e5d-9973-9cfd23a6fb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:54.897546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-34aa816c-6f30-4e5d-9973-9cfd23a6fb04 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:54.898727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-34aa816c-6f30-4e5d-9973-9cfd23a6fb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:54.963300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 382/760] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:54 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:25:54.987326 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acc9a0-3492-44e2-8b57-bf478da790ac None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:55.017904 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:55.090890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acc9a0-3492-44e2-8b57-bf478da790ac None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:55.125124 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b48f7-77c3-41d3-a51c-8ece4ea600b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:55.125699 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b48f7-77c3-41d3-a51c-8ece4ea600b6 None admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:55.125985 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b48f7-77c3-41d3-a51c-8ece4ea600b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:55.126266 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b48f7-77c3-41d3-a51c-8ece4ea600b6 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:55.127045 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b48f7-77c3-41d3-a51c-8ece4ea600b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:55.128417 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b48f7-77c3-41d3-a51c-8ece4ea600b6 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:55.142684 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 379/761] 10.222.0.86 () {60 vars in 1141 bytes} [Fri Jul 15 16:25:54 2022] POST /identity/v3/services => generated 251 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:25:55.625958 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b1506-75cd-40cc-85d8-84c2d236a0c7 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:55.626335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b1506-75cd-40cc-85d8-84c2d236a0c7 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:55.626624 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b1506-75cd-40cc-85d8-84c2d236a0c7 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:55.628027 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 383/762] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:55.633455 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaa2b0-7f3b-4d31-bd37-a856f970e54e None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:55.633751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaa2b0-7f3b-4d31-bd37-a856f970e54e None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:55.634034 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaa2b0-7f3b-4d31-bd37-a856f970e54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:55.651435 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-6faaa2b0-7f3b-4d31-bd37-a856f970e54e None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:55.653124 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-6faaa2b0-7f3b-4d31-bd37-a856f970e54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:55.724936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 380/763] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:55 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:25:55.749541 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b1506-75cd-40cc-85d8-84c2d236a0c7 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:55.838816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:55.848993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b1506-75cd-40cc-85d8-84c2d236a0c7 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:55.885408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966edad-2ede-4be5-a6f1-46e45cc99336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:55.886002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966edad-2ede-4be5-a6f1-46e45cc99336 None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:55.886281 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966edad-2ede-4be5-a6f1-46e45cc99336 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:55.886554 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966edad-2ede-4be5-a6f1-46e45cc99336 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:55.887338 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966edad-2ede-4be5-a6f1-46e45cc99336 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:55.888687 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966edad-2ede-4be5-a6f1-46e45cc99336 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:55.902263 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 384/764] 10.222.0.86 () {60 vars in 1141 bytes} [Fri Jul 15 16:25:55 2022] POST /identity/v3/services => generated 269 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:25:57.399325 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c2327-a1b7-4a3f-b5c3-2a4e311502c7 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:57.399880 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c2327-a1b7-4a3f-b5c3-2a4e311502c7 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:57.399880 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c2327-a1b7-4a3f-b5c3-2a4e311502c7 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:57.401253 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 381/765] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:57.407131 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ff8bb-9145-4a30-b5bd-16b790fd04e3 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:57.407513 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ff8bb-9145-4a30-b5bd-16b790fd04e3 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:57.407684 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ff8bb-9145-4a30-b5bd-16b790fd04e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:57.424450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-777ff8bb-9145-4a30-b5bd-16b790fd04e3 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:57.425617 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-777ff8bb-9145-4a30-b5bd-16b790fd04e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:57.495616 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 385/766] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:57 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:25:57.520007 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c2327-a1b7-4a3f-b5c3-2a4e311502c7 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:57.539523 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:57.623190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c2327-a1b7-4a3f-b5c3-2a4e311502c7 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:57.657857 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39e320-65a9-45d2-b80c-7639327898dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:57.658574 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39e320-65a9-45d2-b80c-7639327898dc None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:57.658877 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39e320-65a9-45d2-b80c-7639327898dc None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:57.659168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39e320-65a9-45d2-b80c-7639327898dc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:57.659823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39e320-65a9-45d2-b80c-7639327898dc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:57.661184 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39e320-65a9-45d2-b80c-7639327898dc None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-5a39e320-65a9-45d2-b80c-7639327898dc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:57.673101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:57.674109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:57.675003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:57.675003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:57.675003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:57.675003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:57.675003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:57.675003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:57.675003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:57.675003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:57.675003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:57.675003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:57.675003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:25:57.675003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:57.675003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 16:25:57.675003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:57.675003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 382/767] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:25:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:25:57.680217 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ff8bb-9145-4a30-b5bd-16b790fd04e3 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:57.756488 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:57.780166 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ff8bb-9145-4a30-b5bd-16b790fd04e3 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:57.812743 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8ab21-ea51-40ea-b4aa-d0ea778377df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:57.813397 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8ab21-ea51-40ea-b4aa-d0ea778377df None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:57.813682 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8ab21-ea51-40ea-b4aa-d0ea778377df None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:57.813958 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8ab21-ea51-40ea-b4aa-d0ea778377df None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:57.814663 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8ab21-ea51-40ea-b4aa-d0ea778377df None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:57.815003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8ab21-ea51-40ea-b4aa-d0ea778377df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:57.816363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8ab21-ea51-40ea-b4aa-d0ea778377df None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:57.820920 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 386/768] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:25:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:57.827357 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39e320-65a9-45d2-b80c-7639327898dc None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:57.921019 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:57.939626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39e320-65a9-45d2-b80c-7639327898dc None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:57.972930 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdec59-b7d0-44fb-8fbc-ea4c767cdc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:57.973617 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdec59-b7d0-44fb-8fbc-ea4c767cdc26 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:57.973907 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdec59-b7d0-44fb-8fbc-ea4c767cdc26 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:57.974186 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdec59-b7d0-44fb-8fbc-ea4c767cdc26 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:57.974942 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdec59-b7d0-44fb-8fbc-ea4c767cdc26 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:57.975261 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdec59-b7d0-44fb-8fbc-ea4c767cdc26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:57.976676 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdec59-b7d0-44fb-8fbc-ea4c767cdc26 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:57.983133 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 383/769] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:25:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:57.989282 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8ab21-ea51-40ea-b4aa-d0ea778377df None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:58.087999 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8ab21-ea51-40ea-b4aa-d0ea778377df None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:58.121703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33da066-7101-4f57-8e9d-b2c8d11e4029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:58.122355 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33da066-7101-4f57-8e9d-b2c8d11e4029 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:58.122643 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33da066-7101-4f57-8e9d-b2c8d11e4029 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:58.123051 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33da066-7101-4f57-8e9d-b2c8d11e4029 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:58.123828 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33da066-7101-4f57-8e9d-b2c8d11e4029 None admin] RBAC: Adding query filter params (interface=public, service_id=c264078f00ab4befb4cd8f03e9102892, region_id=RegionOne) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:58.124147 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33da066-7101-4f57-8e9d-b2c8d11e4029 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:58.125509 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33da066-7101-4f57-8e9d-b2c8d11e4029 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:58.130716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 387/770] 10.222.0.86 () {56 vars in 1251 bytes} [Fri Jul 15 16:25:57 2022] GET /identity/v3/endpoints?service_id=c264078f00ab4befb4cd8f03e9102892&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:58.133911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990271b7-5f2f-4d84-ad9d-26546c6fe58a None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:58.134201 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990271b7-5f2f-4d84-ad9d-26546c6fe58a None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:58.134479 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990271b7-5f2f-4d84-ad9d-26546c6fe58a None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:58.135837 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33da066-7101-4f57-8e9d-b2c8d11e4029 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:58.136134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 384/771] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:25:58.141104 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c936f9-6880-4532-b4b0-5da2c8dad543 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:58.141394 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c936f9-6880-4532-b4b0-5da2c8dad543 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:58.141674 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c936f9-6880-4532-b4b0-5da2c8dad543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:58.144707 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:58.158560 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-d9c936f9-6880-4532-b4b0-5da2c8dad543 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:25:58.159881 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-d9c936f9-6880-4532-b4b0-5da2c8dad543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:25:58.229310 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 385/772] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:25:58 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 16:25:58.243842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33da066-7101-4f57-8e9d-b2c8d11e4029 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:58.253836 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c936f9-6880-4532-b4b0-5da2c8dad543 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:58.279601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1b4f0-c5ff-4b95-bda6-d45b7a9af1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:58.280254 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1b4f0-c5ff-4b95-bda6-d45b7a9af1b2 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:58.280536 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1b4f0-c5ff-4b95-bda6-d45b7a9af1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:58.280827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1b4f0-c5ff-4b95-bda6-d45b7a9af1b2 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:58.281500 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1b4f0-c5ff-4b95-bda6-d45b7a9af1b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:58.282850 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1b4f0-c5ff-4b95-bda6-d45b7a9af1b2 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:58.288797 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 388/773] 10.222.0.86 () {56 vars in 1087 bytes} [Fri Jul 15 16:25:58 2022] GET /identity/v3/services => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 16:25:58.332343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:58.357835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c936f9-6880-4532-b4b0-5da2c8dad543 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:58.393817 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0fbd7-1fc1-4677-8c28-ca9e3217d615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:58.394641 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0fbd7-1fc1-4677-8c28-ca9e3217d615 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:58.394960 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0fbd7-1fc1-4677-8c28-ca9e3217d615 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:58.395238 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0fbd7-1fc1-4677-8c28-ca9e3217d615 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:58.395896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0fbd7-1fc1-4677-8c28-ca9e3217d615 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:58.397271 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0fbd7-1fc1-4677-8c28-ca9e3217d615 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-8cc0fbd7-1fc1-4677-8c28-ca9e3217d615 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:25:58.410038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:25:58.411711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:25:58.412970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 386/774] 10.222.0.86 () {56 vars in 1132 bytes} [Fri Jul 15 16:25:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:25:58.417505 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1b4f0-c5ff-4b95-bda6-d45b7a9af1b2 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:58.490429 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:58.523829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1b4f0-c5ff-4b95-bda6-d45b7a9af1b2 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:58.558354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3da12b-50da-4b69-b565-b0dc17d88de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:58.559080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3da12b-50da-4b69-b565-b0dc17d88de7 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:58.559371 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3da12b-50da-4b69-b565-b0dc17d88de7 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:58.559651 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3da12b-50da-4b69-b565-b0dc17d88de7 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:58.560444 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3da12b-50da-4b69-b565-b0dc17d88de7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:58.560759 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3da12b-50da-4b69-b565-b0dc17d88de7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:58.562123 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3da12b-50da-4b69-b565-b0dc17d88de7 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:58.571487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 389/775] 10.222.0.86 () {56 vars in 1126 bytes} [Fri Jul 15 16:25:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:58.572700 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0fbd7-1fc1-4677-8c28-ca9e3217d615 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:58.671924 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0fbd7-1fc1-4677-8c28-ca9e3217d615 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:58.705698 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baece31-dfd8-478f-a8d9-fab971d588e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:58.706349 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baece31-dfd8-478f-a8d9-fab971d588e8 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:58.706631 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baece31-dfd8-478f-a8d9-fab971d588e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:58.706938 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baece31-dfd8-478f-a8d9-fab971d588e8 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:58.707634 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baece31-dfd8-478f-a8d9-fab971d588e8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:58.707942 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baece31-dfd8-478f-a8d9-fab971d588e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:58.709283 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baece31-dfd8-478f-a8d9-fab971d588e8 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:58.714040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 387/776] 10.222.0.86 () {56 vars in 1126 bytes} [Fri Jul 15 16:25:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:58.719872 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3da12b-50da-4b69-b565-b0dc17d88de7 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:58.818199 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3da12b-50da-4b69-b565-b0dc17d88de7 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:58.852331 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4485802-adb1-416d-809b-0bd2efd4585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:58.852975 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485802-adb1-416d-809b-0bd2efd4585c None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:58.853255 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485802-adb1-416d-809b-0bd2efd4585c None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:58.853527 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485802-adb1-416d-809b-0bd2efd4585c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:58.854299 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4485802-adb1-416d-809b-0bd2efd4585c None admin] RBAC: Adding query filter params (interface=public, service_id=dff1fcb4aa13434b9e7f154911a774cc, region_id=RegionOne) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:25:58.854606 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4485802-adb1-416d-809b-0bd2efd4585c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:58.856034 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4485802-adb1-416d-809b-0bd2efd4585c None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:58.857450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:58.867157 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 390/777] 10.222.0.86 () {56 vars in 1251 bytes} [Fri Jul 15 16:25:58 2022] GET /identity/v3/endpoints?service_id=dff1fcb4aa13434b9e7f154911a774cc&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:25:58.868196 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baece31-dfd8-478f-a8d9-fab971d588e8 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:25:58.873149 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:25:58.966445 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baece31-dfd8-478f-a8d9-fab971d588e8 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:25:58.998916 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a6cb6-8e7e-4015-b8f0-c1087bf17bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:25:58.999576 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a6cb6-8e7e-4015-b8f0-c1087bf17bd9 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:25:58.999860 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a6cb6-8e7e-4015-b8f0-c1087bf17bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:25:59.000134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a6cb6-8e7e-4015-b8f0-c1087bf17bd9 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:25:59.000807 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a6cb6-8e7e-4015-b8f0-c1087bf17bd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:25:59.002163 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a6cb6-8e7e-4015-b8f0-c1087bf17bd9 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:25:59.008311 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 388/778] 10.222.0.86 () {56 vars in 1087 bytes} [Fri Jul 15 16:25:58 2022] GET /identity/v3/services => generated 1498 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 16:26:00.538243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f4578-ef8d-414e-8cbe-072f5f4cb57a None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:00.538768 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f4578-ef8d-414e-8cbe-072f5f4cb57a None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:00.538768 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f4578-ef8d-414e-8cbe-072f5f4cb57a None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:00.540200 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 391/779] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:26:00.545897 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f5254-b5df-4c7b-a546-b0a84d546940 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:00.546300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f5254-b5df-4c7b-a546-b0a84d546940 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:00.546443 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f5254-b5df-4c7b-a546-b0a84d546940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:00.563477 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-9a8f5254-b5df-4c7b-a546-b0a84d546940 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:26:00.564642 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-9a8f5254-b5df-4c7b-a546-b0a84d546940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:26:00.624217 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:00.630267 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 389/780] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:26:00 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:26:00.654654 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f4578-ef8d-414e-8cbe-072f5f4cb57a None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:00.753208 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f4578-ef8d-414e-8cbe-072f5f4cb57a None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:00.787241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2dbae-c810-47c7-9428-773c762aae0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:00.788023 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2dbae-c810-47c7-9428-773c762aae0e None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:00.788353 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2dbae-c810-47c7-9428-773c762aae0e None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:00.788570 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2dbae-c810-47c7-9428-773c762aae0e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:00.789214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2dbae-c810-47c7-9428-773c762aae0e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:00.790551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2dbae-c810-47c7-9428-773c762aae0e None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-d8e2dbae-c810-47c7-9428-773c762aae0e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:26:00.802159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:26:00.803379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:26:00.804449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:26:00.804449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:26:00.804449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:26:00.804449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:26:00.804449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:26:00.804449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:26:00.804449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:26:00.804449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:26:00.804449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:26:00.804449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:26:00.804449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:26:00.804449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:26:00.804449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 16:26:00.804449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:26:00.807011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 392/781] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:26:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:26:00.809139 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f5254-b5df-4c7b-a546-b0a84d546940 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:00.910049 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f5254-b5df-4c7b-a546-b0a84d546940 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:00.943125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad780-7bd0-4574-986a-9a79ebf01536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:00.943785 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad780-7bd0-4574-986a-9a79ebf01536 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:00.944066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad780-7bd0-4574-986a-9a79ebf01536 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:00.944340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad780-7bd0-4574-986a-9a79ebf01536 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:00.945036 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ad780-7bd0-4574-986a-9a79ebf01536 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:26:00.945344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ad780-7bd0-4574-986a-9a79ebf01536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:00.946690 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ad780-7bd0-4574-986a-9a79ebf01536 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:00.952207 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 390/782] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:26:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:26:00.957961 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2dbae-c810-47c7-9428-773c762aae0e None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:01.018044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:01.058080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2dbae-c810-47c7-9428-773c762aae0e None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:01.093735 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd209ee-2ba5-4488-8f09-10d0233d4cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:01.094396 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd209ee-2ba5-4488-8f09-10d0233d4cce None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:01.094679 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd209ee-2ba5-4488-8f09-10d0233d4cce None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:01.094990 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd209ee-2ba5-4488-8f09-10d0233d4cce None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:01.095698 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd209ee-2ba5-4488-8f09-10d0233d4cce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:26:01.096004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd209ee-2ba5-4488-8f09-10d0233d4cce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:01.097355 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd209ee-2ba5-4488-8f09-10d0233d4cce None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:01.102103 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 393/783] 10.222.0.86 () {56 vars in 1114 bytes} [Fri Jul 15 16:26:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:26:01.107805 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad780-7bd0-4574-986a-9a79ebf01536 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:01.167661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:01.206759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad780-7bd0-4574-986a-9a79ebf01536 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:01.211222 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2623d-500d-419d-bdd5-b7e2022a1a3e None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:01.211515 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2623d-500d-419d-bdd5-b7e2022a1a3e None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:01.211798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2623d-500d-419d-bdd5-b7e2022a1a3e None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:01.213163 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 394/784] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:26:01.218131 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1ea61-ccfe-4f06-bd77-2890fc5254d4 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:01.218422 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1ea61-ccfe-4f06-bd77-2890fc5254d4 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:01.218700 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1ea61-ccfe-4f06-bd77-2890fc5254d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:01.235088 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-52a1ea61-ccfe-4f06-bd77-2890fc5254d4 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:26:01.236269 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-52a1ea61-ccfe-4f06-bd77-2890fc5254d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:26:01.240402 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc26c8c-0be9-4776-828a-83388c1381b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:01.241060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26c8c-0be9-4776-828a-83388c1381b0 None admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:01.241348 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26c8c-0be9-4776-828a-83388c1381b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:01.241630 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26c8c-0be9-4776-828a-83388c1381b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:01.242382 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc26c8c-0be9-4776-828a-83388c1381b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:01.243792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc26c8c-0be9-4776-828a-83388c1381b0 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:01.264795 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 391/785] 10.222.0.86 () {60 vars in 1144 bytes} [Fri Jul 15 16:26:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 16:26:01.320198 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 395/786] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:26:01 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 16:26:01.345096 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc26c8c-0be9-4776-828a-83388c1381b0 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:01.450848 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc26c8c-0be9-4776-828a-83388c1381b0 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:01.467653 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:01.485674 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4231ac-172b-4613-9ca1-3aed0f9b6bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:01.486481 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4231ac-172b-4613-9ca1-3aed0f9b6bed None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:01.486760 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4231ac-172b-4613-9ca1-3aed0f9b6bed None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:01.487210 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4231ac-172b-4613-9ca1-3aed0f9b6bed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:01.487890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4231ac-172b-4613-9ca1-3aed0f9b6bed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:01.489243 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4231ac-172b-4613-9ca1-3aed0f9b6bed None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-6a4231ac-172b-4613-9ca1-3aed0f9b6bed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:26:01.502666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:26:01.503854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:01.504875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 392/787] 10.222.0.86 () {56 vars in 1132 bytes} [Fri Jul 15 16:26:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:26:01.509909 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1ea61-ccfe-4f06-bd77-2890fc5254d4 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:01.564773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:01.612695 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1ea61-ccfe-4f06-bd77-2890fc5254d4 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:01.647121 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81234624-06a2-4ef4-a75c-c139de663957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:01.647789 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81234624-06a2-4ef4-a75c-c139de663957 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:01.648073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81234624-06a2-4ef4-a75c-c139de663957 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:01.648350 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81234624-06a2-4ef4-a75c-c139de663957 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:01.649058 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81234624-06a2-4ef4-a75c-c139de663957 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:26:01.649368 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81234624-06a2-4ef4-a75c-c139de663957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:01.650727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81234624-06a2-4ef4-a75c-c139de663957 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:01.655981 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 396/788] 10.222.0.86 () {56 vars in 1126 bytes} [Fri Jul 15 16:26:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:26:01.661818 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4231ac-172b-4613-9ca1-3aed0f9b6bed None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:01.766244 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4231ac-172b-4613-9ca1-3aed0f9b6bed None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:01.799693 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff9697-7a4c-4e34-b012-34289a01cf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:01.800359 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff9697-7a4c-4e34-b012-34289a01cf49 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:01.800647 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff9697-7a4c-4e34-b012-34289a01cf49 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:01.800925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff9697-7a4c-4e34-b012-34289a01cf49 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:01.801628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff9697-7a4c-4e34-b012-34289a01cf49 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:26:01.801941 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff9697-7a4c-4e34-b012-34289a01cf49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:01.803350 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff9697-7a4c-4e34-b012-34289a01cf49 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:01.808421 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 393/789] 10.222.0.86 () {56 vars in 1126 bytes} [Fri Jul 15 16:26:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:26:01.814927 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81234624-06a2-4ef4-a75c-c139de663957 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:01.915536 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81234624-06a2-4ef4-a75c-c139de663957 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:01.932216 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:01.951547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6cf56-c00f-49b0-a107-e9b6602928e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:01.952313 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6cf56-c00f-49b0-a107-e9b6602928e5 None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:01.952608 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6cf56-c00f-49b0-a107-e9b6602928e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:01.952892 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6cf56-c00f-49b0-a107-e9b6602928e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:01.953653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6cf56-c00f-49b0-a107-e9b6602928e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:01.955060 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6cf56-c00f-49b0-a107-e9b6602928e5 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:01.974075 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 397/790] 10.222.0.86 () {60 vars in 1144 bytes} [Fri Jul 15 16:26:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:26:03.533219 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c2b62-da8b-4c3a-b6cf-640615b98f32 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:03.533807 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c2b62-da8b-4c3a-b6cf-640615b98f32 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:03.533912 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c2b62-da8b-4c3a-b6cf-640615b98f32 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:03.535255 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 394/791] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:26:03.540615 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcad2d2-0327-4f7d-91af-516df721f816 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:03.541018 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcad2d2-0327-4f7d-91af-516df721f816 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:03.541176 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcad2d2-0327-4f7d-91af-516df721f816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:03.558232 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-fbcad2d2-0327-4f7d-91af-516df721f816 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:26:03.559458 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-fbcad2d2-0327-4f7d-91af-516df721f816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:26:03.628846 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 398/792] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:26:03 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:26:03.653808 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c2b62-da8b-4c3a-b6cf-640615b98f32 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:03.701112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:03.755718 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c2b62-da8b-4c3a-b6cf-640615b98f32 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:03.790437 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b579a-f4f7-4922-8c67-7f449a24d9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:03.791056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b579a-f4f7-4922-8c67-7f449a24d9e6 None admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:03.791347 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b579a-f4f7-4922-8c67-7f449a24d9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:03.791628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b579a-f4f7-4922-8c67-7f449a24d9e6 None admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:03.792342 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b579a-f4f7-4922-8c67-7f449a24d9e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:03.793904 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b579a-f4f7-4922-8c67-7f449a24d9e6 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:03.795294 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: WARNING keystone.server.flask.common [None req-0b3b579a-f4f7-4922-8c67-7f449a24d9e6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 15 16:26:03.812560 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.sql.core [None req-0b3b579a-f4f7-4922-8c67-7f449a24d9e6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 16:26:03.812560 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 16:26:03.812560 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [parameters: {'id': '3cd9ea513dab4809ba4b5f016c3f4a32', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 16:26:03.812560 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87100) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 16:26:03.830110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-0b3b579a-f4f7-4922-8c67-7f449a24d9e6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3cd9ea513dab4809ba4b5f016c3f4a32.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3cd9ea513dab4809ba4b5f016c3f4a32. Jul 15 16:26:03.830110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:03.830110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 16:26:03.830110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 16:26:03.830110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 16:26:03.830110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 16:26:03.830110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 16:26:03.830110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 16:26:03.830110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 16:26:03.830110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application conn.query(q) Jul 15 16:26:03.830110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 16:26:03.830110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 16:26:03.830110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application result.read() Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 15 16:26:03.831194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application next(self.gen) Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application yield resource Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application next(self.gen) Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise self.value Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application session.commit() Jul 15 16:26:03.832297 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self.session.flush() Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application compat.raise_( Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 16:26:03.833358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 16:26:03.834353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 16:26:03.834353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 16:26:03.834353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 16:26:03.834353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 16:26:03.834353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 15 16:26:03.834353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 15 16:26:03.834353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 16:26:03.834353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 16:26:03.834353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 16:26:03.834353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 16:26:03.834353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 16:26:03.834353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 16:26:03.834353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 16:26:03.834353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 16:26:03.834353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application conn.query(q) Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application result.read() Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 16:26:03.835344 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 16:26:03.836287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 16:26:03.836287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 16:26:03.836287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 16:26:03.836287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 16:26:03.836287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 16:26:03.836287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 16:26:03.836287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 16:26:03.836287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 16:26:03.836287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [parameters: {'id': '3cd9ea513dab4809ba4b5f016c3f4a32', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 16:26:03.836287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 16:26:03.836287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:03.836287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:26:03.836287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:03.836287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:03.836287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:26:03.837343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:26:03.838519 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:26:03.838519 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 15 16:26:03.838519 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 15 16:26:03.838519 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:26:03.838519 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:26:03.838519 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 15 16:26:03.838519 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 15 16:26:03.838519 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3cd9ea513dab4809ba4b5f016c3f4a32. Jul 15 16:26:03.838519 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:03.838519 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 395/793] 10.222.0.86 () {60 vars in 1140 bytes} [Fri Jul 15 16:26:03 2022] POST /identity/v3/projects => generated 262 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:26:03.839256 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcad2d2-0327-4f7d-91af-516df721f816 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:03.934169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:03.938475 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcad2d2-0327-4f7d-91af-516df721f816 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:03.972316 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11113c32-3c65-423c-8576-f09e9cd2dbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:03.973092 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11113c32-3c65-423c-8576-f09e9cd2dbfa None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:03.973374 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11113c32-3c65-423c-8576-f09e9cd2dbfa None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:03.973646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11113c32-3c65-423c-8576-f09e9cd2dbfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:03.980150 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11113c32-3c65-423c-8576-f09e9cd2dbfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:03.981664 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11113c32-3c65-423c-8576-f09e9cd2dbfa None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:03.995201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-11113c32-3c65-423c-8576-f09e9cd2dbfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:26:03.995201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:03.995201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:26:03.995201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:26:03.995201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:26:03.995201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:26:03.995201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:26:03.995201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:26:03.995201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:26:03.995201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:26:03.995201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:26:03.995201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:26:03.995201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:26:03.995201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:26:03.995201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:26:03.996705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:26:03.997688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:26:03.997688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:26:03.997688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:26:03.997688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:26:03.997688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:26:03.997688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:26:03.997688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:26:03.997688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:26:03.997688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 399/794] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:26:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:26:04.003034 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b579a-f4f7-4922-8c67-7f449a24d9e6 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:04.109830 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b579a-f4f7-4922-8c67-7f449a24d9e6 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:04.111439 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:04.145521 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f7b7e-43b0-42a6-9361-cb4ea0ddcc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:04.146184 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f7b7e-43b0-42a6-9361-cb4ea0ddcc8b None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:04.146472 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f7b7e-43b0-42a6-9361-cb4ea0ddcc8b None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:04.146753 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f7b7e-43b0-42a6-9361-cb4ea0ddcc8b None admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:04.147539 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f7b7e-43b0-42a6-9361-cb4ea0ddcc8b None admin] RBAC: Adding query filter params (name=service) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:26:04.147851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f7b7e-43b0-42a6-9361-cb4ea0ddcc8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:04.149464 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f7b7e-43b0-42a6-9361-cb4ea0ddcc8b None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:04.220597 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa234d-bb45-4705-bbbb-147a5a8493d9 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:04.220883 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa234d-bb45-4705-bbbb-147a5a8493d9 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:04.221164 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa234d-bb45-4705-bbbb-147a5a8493d9 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:04.222541 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 400/795] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:26:04.228098 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba502-d04e-49d5-944e-9ac54ee90ead None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:04.228387 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba502-d04e-49d5-944e-9ac54ee90ead None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:04.228668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba502-d04e-49d5-944e-9ac54ee90ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:04.245870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-e7aba502-d04e-49d5-944e-9ac54ee90ead None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:26:04.247669 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-e7aba502-d04e-49d5-944e-9ac54ee90ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:26:04.289669 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 396/796] 10.222.0.86 () {56 vars in 1112 bytes} [Fri Jul 15 16:26:04 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:26:04.324139 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 401/797] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:26:04 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 16:26:04.349334 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f7b7e-43b0-42a6-9361-cb4ea0ddcc8b None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:04.451775 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f7b7e-43b0-42a6-9361-cb4ea0ddcc8b None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:04.486310 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73061ec9-87df-42fe-9a12-f93974fef9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:04.487134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73061ec9-87df-42fe-9a12-f93974fef9a7 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:04.487422 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73061ec9-87df-42fe-9a12-f93974fef9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:04.487697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73061ec9-87df-42fe-9a12-f93974fef9a7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:04.488387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73061ec9-87df-42fe-9a12-f93974fef9a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:04.489745 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73061ec9-87df-42fe-9a12-f93974fef9a7 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-73061ec9-87df-42fe-9a12-f93974fef9a7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:26:04.503094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:26:04.504352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:26:04.505591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:26:04.505591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:26:04.505591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:26:04.505591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:26:04.505591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:26:04.505591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:26:04.505591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:26:04.505591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:26:04.505591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:26:04.505591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:26:04.505591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:26:04.505591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:26:04.505591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 16:26:04.505591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:04.505591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 397/798] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:26:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:26:04.510988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aba502-d04e-49d5-944e-9ac54ee90ead None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:04.598952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:04.611951 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aba502-d04e-49d5-944e-9ac54ee90ead None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:04.645865 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1838f5b-965d-41fe-a397-13fbd1bcae29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:04.646523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1838f5b-965d-41fe-a397-13fbd1bcae29 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:04.646807 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1838f5b-965d-41fe-a397-13fbd1bcae29 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:04.647112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1838f5b-965d-41fe-a397-13fbd1bcae29 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:04.647811 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1838f5b-965d-41fe-a397-13fbd1bcae29 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:26:04.648117 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1838f5b-965d-41fe-a397-13fbd1bcae29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:04.649471 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1838f5b-965d-41fe-a397-13fbd1bcae29 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:04.654114 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 402/799] 10.222.0.86 () {56 vars in 1112 bytes} [Fri Jul 15 16:26:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:26:04.659710 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73061ec9-87df-42fe-9a12-f93974fef9a7 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:04.687176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:04.756826 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73061ec9-87df-42fe-9a12-f93974fef9a7 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:04.789512 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d0c4a-4ade-4120-a8da-efa972f33445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:04.790167 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d0c4a-4ade-4120-a8da-efa972f33445 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:04.790448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d0c4a-4ade-4120-a8da-efa972f33445 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:04.790721 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d0c4a-4ade-4120-a8da-efa972f33445 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:04.791458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d0c4a-4ade-4120-a8da-efa972f33445 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:26:04.791764 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d0c4a-4ade-4120-a8da-efa972f33445 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:04.793150 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d0c4a-4ade-4120-a8da-efa972f33445 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:04.797665 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 398/800] 10.222.0.86 () {56 vars in 1112 bytes} [Fri Jul 15 16:26:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:26:06.580838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc945252-7ba3-4a33-b4c4-bebc762d9c66 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:06.581369 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc945252-7ba3-4a33-b4c4-bebc762d9c66 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:06.581369 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc945252-7ba3-4a33-b4c4-bebc762d9c66 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:06.582755 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 403/801] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:26:06.588288 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36adb1-7ef3-4a24-b400-b99826b5b5bb None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:06.588716 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36adb1-7ef3-4a24-b400-b99826b5b5bb None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:06.588854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36adb1-7ef3-4a24-b400-b99826b5b5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:06.605954 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-7d36adb1-7ef3-4a24-b400-b99826b5b5bb None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:26:06.607486 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-7d36adb1-7ef3-4a24-b400-b99826b5b5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:26:06.672330 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 399/802] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:26:06 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:26:06.698293 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc945252-7ba3-4a33-b4c4-bebc762d9c66 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:06.800543 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc945252-7ba3-4a33-b4c4-bebc762d9c66 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:06.833969 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cd523-1d95-4f69-8dab-bf3d6cf43b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:06.834561 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd523-1d95-4f69-8dab-bf3d6cf43b61 None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:06.834848 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd523-1d95-4f69-8dab-bf3d6cf43b61 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:06.835162 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd523-1d95-4f69-8dab-bf3d6cf43b61 None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:06.835869 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cd523-1d95-4f69-8dab-bf3d6cf43b61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:06.837302 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cd523-1d95-4f69-8dab-bf3d6cf43b61 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:06.838610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: WARNING keystone.server.flask.common [None req-a15cd523-1d95-4f69-8dab-bf3d6cf43b61 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 15 16:26:06.851892 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.sql.core [None req-a15cd523-1d95-4f69-8dab-bf3d6cf43b61 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 16:26:06.851892 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 16:26:06.851892 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [parameters: {'user_id': '40743af8fdd644939c92d1d01cf39b96', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 16:26:06.851892 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87099) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 16:26:06.868678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-a15cd523-1d95-4f69-8dab-bf3d6cf43b61 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 16:26:06.868678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:06.868678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 16:26:06.868678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 16:26:06.868678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 16:26:06.868678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 16:26:06.868678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 16:26:06.868678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 16:26:06.868678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 16:26:06.868678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application conn.query(q) Jul 15 16:26:06.868678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 16:26:06.868678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 16:26:06.868678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 16:26:06.868678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application result.read() Jul 15 16:26:06.868678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 16:26:06.869580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application next(self.gen) Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application yield resource Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application next(self.gen) Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise self.value Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application session.commit() Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 16:26:06.870539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self.session.flush() Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application compat.raise_( Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 16:26:06.871963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 16:26:06.872905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application conn.query(q) Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application result.read() Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 16:26:06.873746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 16:26:06.874563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 16:26:06.874563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 16:26:06.874563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 16:26:06.874563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 16:26:06.874563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 16:26:06.874563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 16:26:06.874563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [parameters: {'user_id': '40743af8fdd644939c92d1d01cf39b96', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 16:26:06.874563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 16:26:06.874563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:26:06.874563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:26:06.874563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:26:06.874563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:06.874563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:26:06.874563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:26:06.874563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 15 16:26:06.875452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 15 16:26:06.876411 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 15 16:26:06.876411 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 15 16:26:06.876411 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 16:26:06.876411 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 16:26:06.876411 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 16:26:06.876411 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:26:06.876411 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 404/803] 10.222.0.86 () {60 vars in 1131 bytes} [Fri Jul 15 16:26:06 2022] POST /identity/v3/users => generated 160 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:26:06.877166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36adb1-7ef3-4a24-b400-b99826b5b5bb None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:06.900552 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:06.978969 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36adb1-7ef3-4a24-b400-b99826b5b5bb None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:07.012727 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86daf45-0a73-4f8e-9de5-881d2167dc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:07.013526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86daf45-0a73-4f8e-9de5-881d2167dc15 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:07.013808 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86daf45-0a73-4f8e-9de5-881d2167dc15 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:07.014082 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86daf45-0a73-4f8e-9de5-881d2167dc15 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:07.014616 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a240292-0d15-4b94-9bd1-6a7aa7980c97 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:07.014936 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a240292-0d15-4b94-9bd1-6a7aa7980c97 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:07.015218 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a240292-0d15-4b94-9bd1-6a7aa7980c97 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:07.019516 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 405/804] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:26:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:26:07.021321 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86daf45-0a73-4f8e-9de5-881d2167dc15 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:07.022826 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86daf45-0a73-4f8e-9de5-881d2167dc15 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:07.024421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15617a6b-1698-487d-a57c-1fc1cbe6b635 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:07.024711 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15617a6b-1698-487d-a57c-1fc1cbe6b635 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:07.024985 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15617a6b-1698-487d-a57c-1fc1cbe6b635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-b86daf45-0a73-4f8e-9de5-881d2167dc15 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:26:07.038172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:26:07.039380 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:26:07.040553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:26:07.040553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:26:07.040553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:26:07.040553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:26:07.040553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:26:07.040553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:26:07.040553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:26:07.040553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:26:07.040553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 16:26:07.040553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:07.042284 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-15617a6b-1698-487d-a57c-1fc1cbe6b635 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:26:07.043148 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 400/805] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:26:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:26:07.043828 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-15617a6b-1698-487d-a57c-1fc1cbe6b635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:26:07.045134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86daf45-0a73-4f8e-9de5-881d2167dc15 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:07.053225 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:07.112970 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 406/806] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:26:07 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:26:07.124709 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:07.136611 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15617a6b-1698-487d-a57c-1fc1cbe6b635 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:07.144875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86daf45-0a73-4f8e-9de5-881d2167dc15 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:07.180751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbb1ae-eaf4-4aeb-8adf-3698456c6fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:07.181437 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbb1ae-eaf4-4aeb-8adf-3698456c6fd4 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:07.181725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbb1ae-eaf4-4aeb-8adf-3698456c6fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:07.182000 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbb1ae-eaf4-4aeb-8adf-3698456c6fd4 None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:07.182809 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbb1ae-eaf4-4aeb-8adf-3698456c6fd4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:26:07.183232 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbb1ae-eaf4-4aeb-8adf-3698456c6fd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:07.185298 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbb1ae-eaf4-4aeb-8adf-3698456c6fd4 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:07.219885 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 401/807] 10.222.0.86 () {56 vars in 1101 bytes} [Fri Jul 15 16:26:07 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:26:07.242573 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15617a6b-1698-487d-a57c-1fc1cbe6b635 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:07.279603 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66917a-f6c3-4b58-9b95-393a563e4985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:07.280404 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66917a-f6c3-4b58-9b95-393a563e4985 None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:07.280735 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66917a-f6c3-4b58-9b95-393a563e4985 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:07.281012 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66917a-f6c3-4b58-9b95-393a563e4985 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:07.281785 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66917a-f6c3-4b58-9b95-393a563e4985 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:07.283455 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66917a-f6c3-4b58-9b95-393a563e4985 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:07.297903 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 407/808] 10.222.0.86 () {60 vars in 1141 bytes} [Fri Jul 15 16:26:07 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 16:26:09.537126 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced4a59-18d5-4825-8e91-4111bdcee546 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:09.537653 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced4a59-18d5-4825-8e91-4111bdcee546 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:09.537773 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced4a59-18d5-4825-8e91-4111bdcee546 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:09.539060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 402/809] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:26:09.544068 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c767d-db58-4495-ac4e-5b3746cbc16a None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:09.544468 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c767d-db58-4495-ac4e-5b3746cbc16a None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:09.544624 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c767d-db58-4495-ac4e-5b3746cbc16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:09.550588 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:09.562338 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-d89c767d-db58-4495-ac4e-5b3746cbc16a None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:26:09.563547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-d89c767d-db58-4495-ac4e-5b3746cbc16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:26:09.632480 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 408/810] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:26:09 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:26:09.657067 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced4a59-18d5-4825-8e91-4111bdcee546 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:09.756390 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced4a59-18d5-4825-8e91-4111bdcee546 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:09.788709 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a4caa-34bf-4da8-a8c2-e03c6f7e19e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:09.789427 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a4caa-34bf-4da8-a8c2-e03c6f7e19e9 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:09.789712 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a4caa-34bf-4da8-a8c2-e03c6f7e19e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:09.789989 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a4caa-34bf-4da8-a8c2-e03c6f7e19e9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:09.790639 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a4caa-34bf-4da8-a8c2-e03c6f7e19e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:09.792026 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a4caa-34bf-4da8-a8c2-e03c6f7e19e9 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-295a4caa-34bf-4da8-a8c2-e03c6f7e19e9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:26:09.804109 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:26:09.805260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:26:09.806483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:26:09.806483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:26:09.806483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:26:09.806483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:26:09.806483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:26:09.806483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:26:09.806483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:26:09.806483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:26:09.806483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:26:09.806483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:26:09.806483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:26:09.806483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:26:09.806483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 16:26:09.806483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:26:09.806483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 403/811] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:26:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:26:09.811773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c767d-db58-4495-ac4e-5b3746cbc16a None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:09.908867 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c767d-db58-4495-ac4e-5b3746cbc16a None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:09.936127 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:09.942145 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633f62e-583c-4873-9cf0-b3da516957b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:09.942799 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633f62e-583c-4873-9cf0-b3da516957b7 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:09.943105 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633f62e-583c-4873-9cf0-b3da516957b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:09.943379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633f62e-583c-4873-9cf0-b3da516957b7 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:09.944082 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633f62e-583c-4873-9cf0-b3da516957b7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:26:09.944389 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633f62e-583c-4873-9cf0-b3da516957b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:09.945746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633f62e-583c-4873-9cf0-b3da516957b7 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:09.950729 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 409/812] 10.222.0.86 () {56 vars in 1112 bytes} [Fri Jul 15 16:26:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:26:09.956382 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a4caa-34bf-4da8-a8c2-e03c6f7e19e9 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:09.959235 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:10.054057 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a4caa-34bf-4da8-a8c2-e03c6f7e19e9 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:10.086091 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca802-f07c-493d-9a01-07103509f3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:10.086739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca802-f07c-493d-9a01-07103509f3e2 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:10.087068 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca802-f07c-493d-9a01-07103509f3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:10.087349 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca802-f07c-493d-9a01-07103509f3e2 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:10.088043 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ca802-f07c-493d-9a01-07103509f3e2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:26:10.088352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ca802-f07c-493d-9a01-07103509f3e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:10.090187 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ca802-f07c-493d-9a01-07103509f3e2 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:10.094918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 404/813] 10.222.0.86 () {56 vars in 1112 bytes} [Fri Jul 15 16:26:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:26:10.100724 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633f62e-583c-4873-9cf0-b3da516957b7 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:10.196503 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633f62e-583c-4873-9cf0-b3da516957b7 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:10.229620 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726bda2-b4f0-40c4-9d6d-28e23cecd889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:10.230260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726bda2-b4f0-40c4-9d6d-28e23cecd889 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:10.231164 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726bda2-b4f0-40c4-9d6d-28e23cecd889 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:10.231443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726bda2-b4f0-40c4-9d6d-28e23cecd889 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:10.232223 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726bda2-b4f0-40c4-9d6d-28e23cecd889 None admin] RBAC: Adding query filter params (interface=public, service_id=142fa93c7d4e49b5969f55105da4efbe, region_id=RegionOne) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:26:10.232539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726bda2-b4f0-40c4-9d6d-28e23cecd889 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:10.233889 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726bda2-b4f0-40c4-9d6d-28e23cecd889 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:10.238778 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 410/814] 10.222.0.86 () {56 vars in 1251 bytes} [Fri Jul 15 16:26:10 2022] GET /identity/v3/endpoints?service_id=142fa93c7d4e49b5969f55105da4efbe&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:26:10.244367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca802-f07c-493d-9a01-07103509f3e2 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:10.308118 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:10.342782 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca802-f07c-493d-9a01-07103509f3e2 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:10.374878 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da42bbb-50c4-4a84-819c-2199fce1a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:10.375534 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42bbb-50c4-4a84-819c-2199fce1a346 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:10.375821 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42bbb-50c4-4a84-819c-2199fce1a346 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:10.376098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42bbb-50c4-4a84-819c-2199fce1a346 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:10.376775 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da42bbb-50c4-4a84-819c-2199fce1a346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:10.378134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da42bbb-50c4-4a84-819c-2199fce1a346 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:10.384213 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 405/815] 10.222.0.86 () {56 vars in 1087 bytes} [Fri Jul 15 16:26:10 2022] GET /identity/v3/services => generated 1728 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 16:26:12.571441 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3658-1433-49a6-ae00-e6898d058e9f None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:12.571999 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3658-1433-49a6-ae00-e6898d058e9f None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:12.571999 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3658-1433-49a6-ae00-e6898d058e9f None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:12.573346 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 411/816] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:26:12.579089 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e47ee3-b9dc-4164-a6a9-0ff58f941ee8 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:12.579482 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e47ee3-b9dc-4164-a6a9-0ff58f941ee8 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:12.579652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e47ee3-b9dc-4164-a6a9-0ff58f941ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:12.595999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-f7e47ee3-b9dc-4164-a6a9-0ff58f941ee8 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:26:12.597179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-f7e47ee3-b9dc-4164-a6a9-0ff58f941ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:26:12.663210 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 406/817] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:26:12 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:26:12.688330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d3658-1433-49a6-ae00-e6898d058e9f None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:12.745429 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:12.786738 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d3658-1433-49a6-ae00-e6898d058e9f None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:12.819453 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5fc0b-887a-486f-99b0-6670db21a9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:12.820265 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5fc0b-887a-486f-99b0-6670db21a9de None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:12.820858 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5fc0b-887a-486f-99b0-6670db21a9de None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:12.831267 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5fc0b-887a-486f-99b0-6670db21a9de None admin] PATH_INFO: `/v3/services/compute` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:12.831909 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5fc0b-887a-486f-99b0-6670db21a9de None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:12.833307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5fc0b-887a-486f-99b0-6670db21a9de None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-30d5fc0b-887a-486f-99b0-6670db21a9de None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:26:12.846551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:26:12.847762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:26:12.848703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:26:12.848703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:26:12.848703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:26:12.848703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:26:12.848703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:26:12.848703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:26:12.848703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:26:12.848703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:26:12.848703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:26:12.848703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:26:12.848703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:26:12.848703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:26:12.848703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 16:26:12.848703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:26:12.848703 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 412/818] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:26:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:26:12.853923 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e47ee3-b9dc-4164-a6a9-0ff58f941ee8 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:12.925273 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:12.964268 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e47ee3-b9dc-4164-a6a9-0ff58f941ee8 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:12.998220 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af7f98-2f35-4819-8042-67bf986dc6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:12.998938 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af7f98-2f35-4819-8042-67bf986dc6a5 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:12.999228 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af7f98-2f35-4819-8042-67bf986dc6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:12.999507 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af7f98-2f35-4819-8042-67bf986dc6a5 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:13.000308 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af7f98-2f35-4819-8042-67bf986dc6a5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:26:13.000623 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af7f98-2f35-4819-8042-67bf986dc6a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:13.001979 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af7f98-2f35-4819-8042-67bf986dc6a5 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:13.006643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 407/819] 10.222.0.86 () {56 vars in 1112 bytes} [Fri Jul 15 16:26:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:26:13.012942 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5fc0b-887a-486f-99b0-6670db21a9de None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:13.108287 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5fc0b-887a-486f-99b0-6670db21a9de None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:13.129529 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:13.141378 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1341ab7-dd29-4a24-a190-25e873b96fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:13.142017 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1341ab7-dd29-4a24-a190-25e873b96fa4 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:13.142298 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1341ab7-dd29-4a24-a190-25e873b96fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:13.142572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1341ab7-dd29-4a24-a190-25e873b96fa4 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:13.143300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1341ab7-dd29-4a24-a190-25e873b96fa4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:26:13.143607 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1341ab7-dd29-4a24-a190-25e873b96fa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:13.144950 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1341ab7-dd29-4a24-a190-25e873b96fa4 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:13.149576 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 413/820] 10.222.0.86 () {56 vars in 1112 bytes} [Fri Jul 15 16:26:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:26:13.155405 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af7f98-2f35-4819-8042-67bf986dc6a5 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:26:13.255047 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af7f98-2f35-4819-8042-67bf986dc6a5 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:26:13.278971 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:13.289916 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2bce2-3877-420c-8121-ec4bfe9f0414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:26:13.290572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2bce2-3877-420c-8121-ec4bfe9f0414 None admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:26:13.290882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2bce2-3877-420c-8121-ec4bfe9f0414 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:26:13.291173 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2bce2-3877-420c-8121-ec4bfe9f0414 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:26:13.291924 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2bce2-3877-420c-8121-ec4bfe9f0414 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:26:13.293319 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2bce2-3877-420c-8121-ec4bfe9f0414 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:26:13.311769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 408/821] 10.222.0.86 () {60 vars in 1144 bytes} [Fri Jul 15 16:26:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:26:23.147266 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=7 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:26:23.307295 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=9,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:13.703466 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5995791-0bef-43ef-81b9-85b560eb5380 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:13.704071 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5995791-0bef-43ef-81b9-85b560eb5380 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:13.704180 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5995791-0bef-43ef-81b9-85b560eb5380 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:13.705547 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 414/822] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:27:13.712993 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f695d74-1b6a-437f-86b3-ba8f5543c80f None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:13.713457 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f695d74-1b6a-437f-86b3-ba8f5543c80f None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:13.713613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f695d74-1b6a-437f-86b3-ba8f5543c80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:13.732882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-5f695d74-1b6a-437f-86b3-ba8f5543c80f None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:27:13.734185 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-5f695d74-1b6a-437f-86b3-ba8f5543c80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:27:13.826666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 409/823] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:27:13 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:27:13.852842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5995791-0bef-43ef-81b9-85b560eb5380 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:13.976685 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5995791-0bef-43ef-81b9-85b560eb5380 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:14.017644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8289306-b3bf-4afe-8017-01d0f15298b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:14.018441 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8289306-b3bf-4afe-8017-01d0f15298b5 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:14.018725 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8289306-b3bf-4afe-8017-01d0f15298b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:14.019036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8289306-b3bf-4afe-8017-01d0f15298b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:14.033438 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8289306-b3bf-4afe-8017-01d0f15298b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:14.034924 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8289306-b3bf-4afe-8017-01d0f15298b5 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:14.055736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-b8289306-b3bf-4afe-8017-01d0f15298b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:14.055736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:14.055736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:14.055736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:14.055736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:14.055736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:14.055736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:14.055736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:14.055736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:14.055736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:14.055736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:14.055736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:14.055736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:27:14.055736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:27:14.055736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:14.057461 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:14.058427 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:27:14.058427 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:27:14.058427 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:14.058427 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:14.058427 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 415/824] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:14.063811 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f695d74-1b6a-437f-86b3-ba8f5543c80f None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:14.176923 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f695d74-1b6a-437f-86b3-ba8f5543c80f None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:14.211600 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:14.223455 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438034fa-370b-4aa1-9448-94dde4d8a9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:14.224135 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438034fa-370b-4aa1-9448-94dde4d8a9bb None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:14.224424 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438034fa-370b-4aa1-9448-94dde4d8a9bb None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:14.224707 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438034fa-370b-4aa1-9448-94dde4d8a9bb None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:14.225429 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438034fa-370b-4aa1-9448-94dde4d8a9bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:14.225738 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438034fa-370b-4aa1-9448-94dde4d8a9bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:14.227184 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438034fa-370b-4aa1-9448-94dde4d8a9bb None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:14.241333 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 410/825] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:27:14.247919 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8289306-b3bf-4afe-8017-01d0f15298b5 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:14.307213 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:14.363532 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8289306-b3bf-4afe-8017-01d0f15298b5 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:14.399688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb63f9-a521-4047-8d83-c1e57fc10ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:14.400890 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb63f9-a521-4047-8d83-c1e57fc10ca6 None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:14.401303 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb63f9-a521-4047-8d83-c1e57fc10ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:14.401750 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb63f9-a521-4047-8d83-c1e57fc10ca6 None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:14.403625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb63f9-a521-4047-8d83-c1e57fc10ca6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:14.409226 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb63f9-a521-4047-8d83-c1e57fc10ca6 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:14.444696 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 416/826] 10.222.0.86 () {60 vars in 1132 bytes} [Fri Jul 15 16:27:14 2022] POST /identity/v3/users => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:27:16.944804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a455508-a90e-4f50-87d2-e0c9073a9335 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:16.945360 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a455508-a90e-4f50-87d2-e0c9073a9335 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:16.945360 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a455508-a90e-4f50-87d2-e0c9073a9335 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:16.946995 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 411/827] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:27:16.953206 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70a542-459c-4b07-ae8e-c9dde2e04942 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:16.953640 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70a542-459c-4b07-ae8e-c9dde2e04942 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:16.953783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70a542-459c-4b07-ae8e-c9dde2e04942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:16.973106 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-4d70a542-459c-4b07-ae8e-c9dde2e04942 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:27:16.974426 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-4d70a542-459c-4b07-ae8e-c9dde2e04942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:27:17.047512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 417/828] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:27:16 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:27:17.074890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a455508-a90e-4f50-87d2-e0c9073a9335 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:17.186182 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a455508-a90e-4f50-87d2-e0c9073a9335 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:17.224028 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffc125-1b08-4807-b3ea-382d92273fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:17.224885 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffc125-1b08-4807-b3ea-382d92273fac None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:17.225213 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffc125-1b08-4807-b3ea-382d92273fac None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:17.225546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffc125-1b08-4807-b3ea-382d92273fac None admin] PATH_INFO: `/v3/roles/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:17.237318 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffc125-1b08-4807-b3ea-382d92273fac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-27ffc125-1b08-4807-b3ea-382d92273fac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:27:17.245592 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:17.246792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:17.247679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:17.247679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:17.247679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:17.247679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:17.247679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:27:17.247679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:27:17.247679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:27:17.247679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:27:17.247679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:27:17.247679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:27:17.247679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:27:17.247679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:17.247679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 412/829] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:27:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:17.252820 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70a542-459c-4b07-ae8e-c9dde2e04942 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:17.297645 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:17.366210 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70a542-459c-4b07-ae8e-c9dde2e04942 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:17.408590 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5ba53-fdad-417f-925f-ce2b0c487728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:17.409540 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5ba53-fdad-417f-925f-ce2b0c487728 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:17.409827 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5ba53-fdad-417f-925f-ce2b0c487728 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:17.410105 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5ba53-fdad-417f-925f-ce2b0c487728 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:17.410894 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b5ba53-fdad-417f-925f-ce2b0c487728 None admin] RBAC: Adding query filter params (name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:17.411203 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b5ba53-fdad-417f-925f-ce2b0c487728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:17.412565 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b5ba53-fdad-417f-925f-ce2b0c487728 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:17.421441 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 418/830] 10.222.0.86 () {56 vars in 1103 bytes} [Fri Jul 15 16:27:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:17.427518 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffc125-1b08-4807-b3ea-382d92273fac None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:17.479470 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:17.539884 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffc125-1b08-4807-b3ea-382d92273fac None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:17.580451 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff69275-dae1-4bbe-97c4-67d2d309a54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:17.581514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff69275-dae1-4bbe-97c4-67d2d309a54a None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:17.581905 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff69275-dae1-4bbe-97c4-67d2d309a54a None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:17.582190 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff69275-dae1-4bbe-97c4-67d2d309a54a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:17.598574 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff69275-dae1-4bbe-97c4-67d2d309a54a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:17.598574 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff69275-dae1-4bbe-97c4-67d2d309a54a None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:17.616844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-bff69275-dae1-4bbe-97c4-67d2d309a54a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:17.616844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:17.616844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:17.616844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:17.616844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:17.616844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:17.616844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:17.616844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:17.616844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:17.616844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:17.616844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:17.616844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:17.616844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:27:17.616844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:27:17.616844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:17.618015 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:17.619585 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:27:17.619585 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:27:17.619585 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:17.619585 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:17.619585 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 413/831] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:17.624989 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5ba53-fdad-417f-925f-ce2b0c487728 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:17.739123 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:17.742439 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5ba53-fdad-417f-925f-ce2b0c487728 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:17.780601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcb390-88e0-492a-a065-1fb377b5025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:17.781369 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcb390-88e0-492a-a065-1fb377b5025a None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:17.781537 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcb390-88e0-492a-a065-1fb377b5025a None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:17.781931 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcb390-88e0-492a-a065-1fb377b5025a None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:17.782632 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcb390-88e0-492a-a065-1fb377b5025a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:17.783060 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcb390-88e0-492a-a065-1fb377b5025a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:17.784543 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcb390-88e0-492a-a065-1fb377b5025a None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:17.801093 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 419/832] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:17.807987 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff69275-dae1-4bbe-97c4-67d2d309a54a None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:17.923861 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:17.927947 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff69275-dae1-4bbe-97c4-67d2d309a54a None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:17.963411 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279f4dd-756a-4f9b-b056-a86ea6011a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:17.964495 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279f4dd-756a-4f9b-b056-a86ea6011a7a None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:17.964495 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279f4dd-756a-4f9b-b056-a86ea6011a7a None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:17.964759 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279f4dd-756a-4f9b-b056-a86ea6011a7a None admin] PATH_INFO: `/v3/users/placement` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:17.974578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279f4dd-756a-4f9b-b056-a86ea6011a7a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:17.976660 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279f4dd-756a-4f9b-b056-a86ea6011a7a None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-2279f4dd-756a-4f9b-b056-a86ea6011a7a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:27:17.999309 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:18.000469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:18.001610 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:18.001610 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:18.001610 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:27:18.001610 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:27:18.001610 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:27:18.001610 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:27:18.001610 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:27:18.001610 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:27:18.001610 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 16:27:18.001610 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:18.001610 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 414/833] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:18.007453 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcb390-88e0-492a-a065-1fb377b5025a None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:18.130094 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcb390-88e0-492a-a065-1fb377b5025a None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:18.167660 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b94565-4adc-461b-bb92-b68d4e314305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:18.168323 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b94565-4adc-461b-bb92-b68d4e314305 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:18.168603 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b94565-4adc-461b-bb92-b68d4e314305 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:18.168874 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b94565-4adc-461b-bb92-b68d4e314305 None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:18.169702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b94565-4adc-461b-bb92-b68d4e314305 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:18.170032 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b94565-4adc-461b-bb92-b68d4e314305 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:18.171493 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b94565-4adc-461b-bb92-b68d4e314305 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:18.194675 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 420/834] 10.222.0.86 () {56 vars in 1143 bytes} [Fri Jul 15 16:27:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:18.201234 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279f4dd-756a-4f9b-b056-a86ea6011a7a None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:18.305377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279f4dd-756a-4f9b-b056-a86ea6011a7a None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:18.339559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bce4c6-ca18-44de-8912-73fd8a639057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:18.340207 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bce4c6-ca18-44de-8912-73fd8a639057 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:18.340496 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bce4c6-ca18-44de-8912-73fd8a639057 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:18.340777 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bce4c6-ca18-44de-8912-73fd8a639057 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:18.367864 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:18.409485 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bce4c6-ca18-44de-8912-73fd8a639057 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:18.411035 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bce4c6-ca18-44de-8912-73fd8a639057 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:18.515510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 415/835] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:27:18 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 16:27:18.521651 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b94565-4adc-461b-bb92-b68d4e314305 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:18.541874 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:18.625918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b94565-4adc-461b-bb92-b68d4e314305 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:18.664321 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de303b6-cbb9-4967-b605-3d467b05db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:18.665380 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de303b6-cbb9-4967-b605-3d467b05db40 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:18.665685 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de303b6-cbb9-4967-b605-3d467b05db40 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:18.665954 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de303b6-cbb9-4967-b605-3d467b05db40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:18.676175 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de303b6-cbb9-4967-b605-3d467b05db40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:18.677621 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de303b6-cbb9-4967-b605-3d467b05db40 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:18.696073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-6de303b6-cbb9-4967-b605-3d467b05db40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:18.696073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:18.696073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:18.696073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:18.696073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:18.696073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:18.696073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:18.696073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:18.696073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:18.696073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:18.696073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:18.696073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:18.696073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:27:18.696073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:27:18.696073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:18.697639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:18.699011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:27:18.699011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:27:18.699011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:18.699011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:18.699011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 421/836] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:18.704198 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bce4c6-ca18-44de-8912-73fd8a639057 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:18.762850 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:18.805045 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bce4c6-ca18-44de-8912-73fd8a639057 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:18.844613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa7aba-cf7c-4558-96a1-bbd967502158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:18.845281 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa7aba-cf7c-4558-96a1-bbd967502158 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:18.845567 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa7aba-cf7c-4558-96a1-bbd967502158 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:18.845846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa7aba-cf7c-4558-96a1-bbd967502158 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:18.846556 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa7aba-cf7c-4558-96a1-bbd967502158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:18.846878 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa7aba-cf7c-4558-96a1-bbd967502158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:18.848349 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa7aba-cf7c-4558-96a1-bbd967502158 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:18.860786 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 416/837] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:27:18.866273 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de303b6-cbb9-4967-b605-3d467b05db40 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:18.941440 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:18.974996 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de303b6-cbb9-4967-b605-3d467b05db40 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:19.015646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5301a-11a2-4c4c-95af-93273cdc176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:19.016467 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5301a-11a2-4c4c-95af-93273cdc176d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:19.016835 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5301a-11a2-4c4c-95af-93273cdc176d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:19.017122 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5301a-11a2-4c4c-95af-93273cdc176d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:19.024702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5301a-11a2-4c4c-95af-93273cdc176d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:19.026730 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5301a-11a2-4c4c-95af-93273cdc176d None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:19.042849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-5ec5301a-11a2-4c4c-95af-93273cdc176d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:27:19.042849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:19.042849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:19.042849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:19.042849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:19.042849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:19.042849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:19.042849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:19.042849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:19.042849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:19.042849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:19.042849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:19.042849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:27:19.042849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:27:19.042849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:19.043885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:19.044782 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:27:19.044782 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:27:19.044782 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:27:19.044782 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:27:19.044782 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:27:19.044782 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:27:19.044782 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:27:19.044782 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:19.044782 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 422/838] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:27:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:19.050366 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa7aba-cf7c-4558-96a1-bbd967502158 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:19.159603 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa7aba-cf7c-4558-96a1-bbd967502158 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:19.177860 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:19.195367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc886b-6e06-4aaa-b039-9259cf027784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:19.195986 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc886b-6e06-4aaa-b039-9259cf027784 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:19.196278 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc886b-6e06-4aaa-b039-9259cf027784 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:19.196541 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc886b-6e06-4aaa-b039-9259cf027784 None admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:19.197362 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc886b-6e06-4aaa-b039-9259cf027784 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:19.197677 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc886b-6e06-4aaa-b039-9259cf027784 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:19.199396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc886b-6e06-4aaa-b039-9259cf027784 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:19.211640 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 417/839] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:19.218468 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5301a-11a2-4c4c-95af-93273cdc176d None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:19.328361 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5301a-11a2-4c4c-95af-93273cdc176d None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:19.358442 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:19.365377 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b03d33-948e-439a-b927-1aaf8d8488e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:19.366033 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b03d33-948e-439a-b927-1aaf8d8488e4 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:19.366320 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b03d33-948e-439a-b927-1aaf8d8488e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:19.366601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b03d33-948e-439a-b927-1aaf8d8488e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:19.367489 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b03d33-948e-439a-b927-1aaf8d8488e4 None admin] RBAC: Adding query filter params (role.id=0d630eb5fff7436391281167da032c15, scope.project.id=db599cc43051468cbf306faba2431b23, user.id=f716b4b39b3d4547ab937f5a5ffccf08) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:19.367806 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b03d33-948e-439a-b927-1aaf8d8488e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:19.369771 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b03d33-948e-439a-b927-1aaf8d8488e4 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:19.375549 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 423/840] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:27:19 2022] GET /identity/v3/role_assignments?user.id=f716b4b39b3d4547ab937f5a5ffccf08&scope.project.id=db599cc43051468cbf306faba2431b23&role.id=0d630eb5fff7436391281167da032c15 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:21.719633 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1da33-76bc-4bc4-9058-2454a6c20e3b None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:21.720206 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1da33-76bc-4bc4-9058-2454a6c20e3b None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:21.720206 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1da33-76bc-4bc4-9058-2454a6c20e3b None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:21.721603 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 418/841] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:27:21.727755 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c22b1-5a4b-44b2-9f82-e2e3f987755d None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:21.728267 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c22b1-5a4b-44b2-9f82-e2e3f987755d None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:21.728359 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c22b1-5a4b-44b2-9f82-e2e3f987755d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:21.745269 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-3b1c22b1-5a4b-44b2-9f82-e2e3f987755d None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:27:21.746577 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-3b1c22b1-5a4b-44b2-9f82-e2e3f987755d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:27:21.823546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 424/842] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:27:21 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:27:21.850092 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1da33-76bc-4bc4-9058-2454a6c20e3b None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:21.966161 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1da33-76bc-4bc4-9058-2454a6c20e3b None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:22.008346 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff6a1b-08e3-45ff-9f34-1448e01c2da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:22.009638 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff6a1b-08e3-45ff-9f34-1448e01c2da1 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:22.009902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff6a1b-08e3-45ff-9f34-1448e01c2da1 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:22.010177 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff6a1b-08e3-45ff-9f34-1448e01c2da1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:22.020806 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff6a1b-08e3-45ff-9f34-1448e01c2da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-49ff6a1b-08e3-45ff-9f34-1448e01c2da1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:27:22.029062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:22.030458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:22.031508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:22.031508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:22.031508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:22.031508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:22.031508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:27:22.031508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:27:22.031508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:27:22.031508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:27:22.031508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:27:22.031508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:27:22.031508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:27:22.031508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:22.035508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 419/843] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:27:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:22.036402 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c22b1-5a4b-44b2-9f82-e2e3f987755d None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:22.145031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c22b1-5a4b-44b2-9f82-e2e3f987755d None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:22.172271 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:22.184618 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7fad1-7e17-4d8d-bf95-e9bd08228a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:22.185195 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7fad1-7e17-4d8d-bf95-e9bd08228a05 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:22.185489 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7fad1-7e17-4d8d-bf95-e9bd08228a05 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:22.185755 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7fad1-7e17-4d8d-bf95-e9bd08228a05 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:22.186609 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7fad1-7e17-4d8d-bf95-e9bd08228a05 None admin] RBAC: Adding query filter params (name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:22.186945 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7fad1-7e17-4d8d-bf95-e9bd08228a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:22.188253 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7fad1-7e17-4d8d-bf95-e9bd08228a05 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:22.197367 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 425/844] 10.222.0.86 () {56 vars in 1103 bytes} [Fri Jul 15 16:27:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:22.203627 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff6a1b-08e3-45ff-9f34-1448e01c2da1 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:22.246283 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:22.312933 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff6a1b-08e3-45ff-9f34-1448e01c2da1 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:22.348391 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27654f39-c111-4271-b419-5210b41b660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:22.349543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27654f39-c111-4271-b419-5210b41b660b None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:22.349882 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27654f39-c111-4271-b419-5210b41b660b None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:22.350423 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27654f39-c111-4271-b419-5210b41b660b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:22.362138 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27654f39-c111-4271-b419-5210b41b660b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:22.363618 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27654f39-c111-4271-b419-5210b41b660b None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:22.380918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-27654f39-c111-4271-b419-5210b41b660b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:22.380918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:22.380918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:22.380918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:22.380918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:22.380918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:22.380918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:22.380918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:22.380918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:22.380918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:22.380918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:22.380918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:22.380918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:27:22.380918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:27:22.380918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:22.381982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:22.383140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:27:22.383140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:27:22.383140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:22.383140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:22.383140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 420/845] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:22.388455 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7fad1-7e17-4d8d-bf95-e9bd08228a05 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:22.496428 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7fad1-7e17-4d8d-bf95-e9bd08228a05 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:22.535732 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b21ce7-a478-46af-96e4-8edef3ee6ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:22.536398 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b21ce7-a478-46af-96e4-8edef3ee6ff6 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:22.536681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b21ce7-a478-46af-96e4-8edef3ee6ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:22.536961 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b21ce7-a478-46af-96e4-8edef3ee6ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:22.537690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b21ce7-a478-46af-96e4-8edef3ee6ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:22.537995 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b21ce7-a478-46af-96e4-8edef3ee6ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:22.539445 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b21ce7-a478-46af-96e4-8edef3ee6ff6 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:22.552593 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 426/846] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:22.559417 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27654f39-c111-4271-b419-5210b41b660b None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:22.658125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:22.669921 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27654f39-c111-4271-b419-5210b41b660b None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:22.710275 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc9a91-0a9f-4ecb-9ad8-bb5a12177e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:22.711111 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc9a91-0a9f-4ecb-9ad8-bb5a12177e21 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:22.711396 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc9a91-0a9f-4ecb-9ad8-bb5a12177e21 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:22.711698 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc9a91-0a9f-4ecb-9ad8-bb5a12177e21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:22.720540 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc9a91-0a9f-4ecb-9ad8-bb5a12177e21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:22.722156 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc9a91-0a9f-4ecb-9ad8-bb5a12177e21 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-d9cc9a91-0a9f-4ecb-9ad8-bb5a12177e21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:27:22.736851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:22.738175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:22.739300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:22.739300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:22.739300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:27:22.739300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:27:22.739300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:27:22.739300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:27:22.739300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:27:22.739300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:27:22.739300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 16:27:22.739300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:22.739300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 421/847] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:22.746795 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b21ce7-a478-46af-96e4-8edef3ee6ff6 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:22.803989 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:22.872939 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b21ce7-a478-46af-96e4-8edef3ee6ff6 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:22.912463 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3ed74-a6bb-4b1e-8c69-0ad068316059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:22.913230 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3ed74-a6bb-4b1e-8c69-0ad068316059 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:22.913494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3ed74-a6bb-4b1e-8c69-0ad068316059 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:22.913881 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3ed74-a6bb-4b1e-8c69-0ad068316059 None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:22.914947 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3ed74-a6bb-4b1e-8c69-0ad068316059 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:22.915275 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3ed74-a6bb-4b1e-8c69-0ad068316059 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:22.916989 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3ed74-a6bb-4b1e-8c69-0ad068316059 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:22.936690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 427/848] 10.222.0.86 () {56 vars in 1143 bytes} [Fri Jul 15 16:27:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:22.942367 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc9a91-0a9f-4ecb-9ad8-bb5a12177e21 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:23.062032 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc9a91-0a9f-4ecb-9ad8-bb5a12177e21 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:23.097616 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a840b-f6cb-4f94-a247-d3c946ea5ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:23.098559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a840b-f6cb-4f94-a247-d3c946ea5ff9 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:23.098960 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a840b-f6cb-4f94-a247-d3c946ea5ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:23.099283 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a840b-f6cb-4f94-a247-d3c946ea5ff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:23.113566 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a840b-f6cb-4f94-a247-d3c946ea5ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:23.115064 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a840b-f6cb-4f94-a247-d3c946ea5ff9 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:23.135377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-cf5a840b-f6cb-4f94-a247-d3c946ea5ff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:23.135377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:23.135377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:23.135377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:23.135377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:23.135377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:23.135377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:23.135377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:23.135377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:23.135377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:23.135377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:23.135377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:23.135377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:27:23.135377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:27:23.135377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:23.136531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:23.139951 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:27:23.139951 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:27:23.139951 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:23.139951 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:23.139951 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 422/849] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:23.142451 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3ed74-a6bb-4b1e-8c69-0ad068316059 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:23.259221 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3ed74-a6bb-4b1e-8c69-0ad068316059 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:23.262242 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:23.301382 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec48c6c-eda2-4d6d-b5ec-a8ad1c9c03e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:23.302296 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec48c6c-eda2-4d6d-b5ec-a8ad1c9c03e8 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:23.302712 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec48c6c-eda2-4d6d-b5ec-a8ad1c9c03e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:23.303033 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec48c6c-eda2-4d6d-b5ec-a8ad1c9c03e8 None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:23.304008 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec48c6c-eda2-4d6d-b5ec-a8ad1c9c03e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:23.304315 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec48c6c-eda2-4d6d-b5ec-a8ad1c9c03e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:23.306676 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec48c6c-eda2-4d6d-b5ec-a8ad1c9c03e8 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:23.319929 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 428/850] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:23.325869 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a840b-f6cb-4f94-a247-d3c946ea5ff9 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:23.328974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:23.444520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a840b-f6cb-4f94-a247-d3c946ea5ff9 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:23.479960 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4254c-8467-4364-b781-eb387f9d67eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:23.480824 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4254c-8467-4364-b781-eb387f9d67eb None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:23.481152 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4254c-8467-4364-b781-eb387f9d67eb None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:23.481403 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4254c-8467-4364-b781-eb387f9d67eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:23.489021 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4254c-8467-4364-b781-eb387f9d67eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:23.490599 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4254c-8467-4364-b781-eb387f9d67eb None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:23.511538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-73b4254c-8467-4364-b781-eb387f9d67eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:27:23.511538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:23.511538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:23.511538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:23.511538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:23.511538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:23.511538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:23.511538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:23.511538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:23.511538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:23.511538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:23.511538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:23.511538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:27:23.511538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:27:23.511538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:23.512692 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:23.513811 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:27:23.513811 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:27:23.513811 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:27:23.513811 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:27:23.513811 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:27:23.513811 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:27:23.513811 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:27:23.513811 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:23.515096 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 423/851] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:23.520971 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec48c6c-eda2-4d6d-b5ec-a8ad1c9c03e8 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:23.639851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec48c6c-eda2-4d6d-b5ec-a8ad1c9c03e8 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:23.677211 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ed34d-e8eb-451a-ac7b-2d307bb57a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:23.677912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ed34d-e8eb-451a-ac7b-2d307bb57a48 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:23.678281 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ed34d-e8eb-451a-ac7b-2d307bb57a48 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:23.678689 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ed34d-e8eb-451a-ac7b-2d307bb57a48 None admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:23.679515 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ed34d-e8eb-451a-ac7b-2d307bb57a48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:23.679845 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ed34d-e8eb-451a-ac7b-2d307bb57a48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:23.681957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ed34d-e8eb-451a-ac7b-2d307bb57a48 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:23.695645 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 429/852] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:27:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:23.702932 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4254c-8467-4364-b781-eb387f9d67eb None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:23.768832 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:23.811428 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4254c-8467-4364-b781-eb387f9d67eb None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:23.849204 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1554b21-9283-4d4e-aeb9-c4bd06547768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:23.850503 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1554b21-9283-4d4e-aeb9-c4bd06547768 None admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:23.851082 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1554b21-9283-4d4e-aeb9-c4bd06547768 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:23.851389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1554b21-9283-4d4e-aeb9-c4bd06547768 None admin] PATH_INFO: `/v3/projects/db599cc43051468cbf306faba2431b23/users/f716b4b39b3d4547ab937f5a5ffccf08/roles/0d630eb5fff7436391281167da032c15` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:23.869346 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1554b21-9283-4d4e-aeb9-c4bd06547768 None admin] RBAC: Authorizing `identity:create_grant(project_id=db599cc43051468cbf306faba2431b23, user_id=f716b4b39b3d4547ab937f5a5ffccf08, role_id=0d630eb5fff7436391281167da032c15)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:23.870986 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1554b21-9283-4d4e-aeb9-c4bd06547768 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:23.883225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 424/853] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:27:23 2022] PUT /identity/v3/projects/db599cc43051468cbf306faba2431b23/users/f716b4b39b3d4547ab937f5a5ffccf08/roles/0d630eb5fff7436391281167da032c15 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:27:26.475031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c76fb9-7f21-4ba3-8788-7571b39273e8 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:26.478763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c76fb9-7f21-4ba3-8788-7571b39273e8 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:26.478763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c76fb9-7f21-4ba3-8788-7571b39273e8 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:26.478763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 430/854] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:27:26.483827 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40589b-9a94-4133-9118-3c5814b0e4ee None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:26.484282 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40589b-9a94-4133-9118-3c5814b0e4ee None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:26.484382 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40589b-9a94-4133-9118-3c5814b0e4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:26.501748 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-3c40589b-9a94-4133-9118-3c5814b0e4ee None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:27:26.503330 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-3c40589b-9a94-4133-9118-3c5814b0e4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:27:26.591442 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 425/855] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:27:26 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:27:26.617327 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c76fb9-7f21-4ba3-8788-7571b39273e8 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:26.645068 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:26.731294 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c76fb9-7f21-4ba3-8788-7571b39273e8 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:26.768867 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aee25a-c3ff-4d10-bb12-525bda2db312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:26.769769 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aee25a-c3ff-4d10-bb12-525bda2db312 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:26.770070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aee25a-c3ff-4d10-bb12-525bda2db312 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:26.770420 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aee25a-c3ff-4d10-bb12-525bda2db312 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:26.784400 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aee25a-c3ff-4d10-bb12-525bda2db312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-c7aee25a-c3ff-4d10-bb12-525bda2db312 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:27:26.793914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:26.794993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:26.795842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:26.795842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:26.795842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:26.795842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:26.795842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:27:26.795842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:27:26.795842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:27:26.795842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:27:26.795842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:27:26.795842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:27:26.795842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 16:27:26.795842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:26.795842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 431/856] 10.222.0.86 () {56 vars in 1102 bytes} [Fri Jul 15 16:27:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:26.801544 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40589b-9a94-4133-9118-3c5814b0e4ee None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:26.849671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:26.912120 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40589b-9a94-4133-9118-3c5814b0e4ee None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:26.950718 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc18dae-3035-488d-ba7d-4eb2fd86beee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:26.951419 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc18dae-3035-488d-ba7d-4eb2fd86beee None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:26.951707 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc18dae-3035-488d-ba7d-4eb2fd86beee None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:26.951983 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc18dae-3035-488d-ba7d-4eb2fd86beee None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:26.952724 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc18dae-3035-488d-ba7d-4eb2fd86beee None admin] RBAC: Adding query filter params (name=service) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:26.953034 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc18dae-3035-488d-ba7d-4eb2fd86beee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:26.954635 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc18dae-3035-488d-ba7d-4eb2fd86beee None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:26.964933 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 426/857] 10.222.0.86 () {56 vars in 1103 bytes} [Fri Jul 15 16:27:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:26.970838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aee25a-c3ff-4d10-bb12-525bda2db312 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:27.064892 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:27.084148 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aee25a-c3ff-4d10-bb12-525bda2db312 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:27.120715 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f95527-d9da-4e73-9388-59a3901cf57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:27.121573 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f95527-d9da-4e73-9388-59a3901cf57f None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:27.122854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f95527-d9da-4e73-9388-59a3901cf57f None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:27.123170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f95527-d9da-4e73-9388-59a3901cf57f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:27.134243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f95527-d9da-4e73-9388-59a3901cf57f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:27.135717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f95527-d9da-4e73-9388-59a3901cf57f None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:27.155366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-02f95527-d9da-4e73-9388-59a3901cf57f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:27.155366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:27.155366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:27.155366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:27.155366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:27.155366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:27.155366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:27.155366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:27.155366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:27.155366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:27.155366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:27.155366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:27.155366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:27:27.155366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:27:27.155366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:27.156301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:27.157179 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:27:27.157179 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:27:27.157179 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:27.157179 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:27.157179 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 432/858] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:27:27.163151 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc18dae-3035-488d-ba7d-4eb2fd86beee None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:27.272439 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc18dae-3035-488d-ba7d-4eb2fd86beee None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:27.275479 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:27.311193 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac326a41-47cb-4059-be2f-8698a52f2d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:27.312137 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac326a41-47cb-4059-be2f-8698a52f2d30 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:27.312580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac326a41-47cb-4059-be2f-8698a52f2d30 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:27.313044 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac326a41-47cb-4059-be2f-8698a52f2d30 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:27.313768 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac326a41-47cb-4059-be2f-8698a52f2d30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:27.314078 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac326a41-47cb-4059-be2f-8698a52f2d30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:27.315607 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac326a41-47cb-4059-be2f-8698a52f2d30 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:27.327671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 427/859] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:27.333934 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f95527-d9da-4e73-9388-59a3901cf57f None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:27.449543 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f95527-d9da-4e73-9388-59a3901cf57f None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:27.485604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d237794-805b-4bb3-a12e-256545be02ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:27.486503 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d237794-805b-4bb3-a12e-256545be02ea None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:27.486857 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d237794-805b-4bb3-a12e-256545be02ea None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:27.487228 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d237794-805b-4bb3-a12e-256545be02ea None admin] PATH_INFO: `/v3/users/placement` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:27.490398 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:27.496548 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d237794-805b-4bb3-a12e-256545be02ea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:27.498296 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d237794-805b-4bb3-a12e-256545be02ea None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-4d237794-805b-4bb3-a12e-256545be02ea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:27:27.515003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:27.516312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:27.517773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:27.517773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:27.517773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:27:27.517773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:27:27.517773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:27:27.517773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:27:27.517773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:27:27.517773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:27:27.517773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 16:27:27.517773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:27.517773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 433/860] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:27.522131 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac326a41-47cb-4059-be2f-8698a52f2d30 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:27.636285 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac326a41-47cb-4059-be2f-8698a52f2d30 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:27.675341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f12a5-820e-486a-a08e-cea9e67a820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:27.676011 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f12a5-820e-486a-a08e-cea9e67a820d None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:27.676299 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f12a5-820e-486a-a08e-cea9e67a820d None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:27.676578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f12a5-820e-486a-a08e-cea9e67a820d None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:27.677416 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f12a5-820e-486a-a08e-cea9e67a820d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:27.677733 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f12a5-820e-486a-a08e-cea9e67a820d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:27.679177 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f12a5-820e-486a-a08e-cea9e67a820d None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:27.697663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 428/861] 10.222.0.86 () {56 vars in 1143 bytes} [Fri Jul 15 16:27:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:27.703775 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d237794-805b-4bb3-a12e-256545be02ea None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:27.812917 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d237794-805b-4bb3-a12e-256545be02ea None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:27.848508 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080384a-17d8-4715-bcb6-9ae37f9be19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:27.849146 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080384a-17d8-4715-bcb6-9ae37f9be19c None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:27.849472 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080384a-17d8-4715-bcb6-9ae37f9be19c None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:27.849763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080384a-17d8-4715-bcb6-9ae37f9be19c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:27.913488 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:27.921307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080384a-17d8-4715-bcb6-9ae37f9be19c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:27.928418 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080384a-17d8-4715-bcb6-9ae37f9be19c None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:28.054285 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 434/862] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:27:27 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 16:27:28.060764 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f12a5-820e-486a-a08e-cea9e67a820d None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:28.092308 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:28.185132 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f12a5-820e-486a-a08e-cea9e67a820d None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:28.228282 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b18db-6a21-46a5-a221-c694bff9d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:28.229077 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b18db-6a21-46a5-a221-c694bff9d8aa None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:28.229370 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b18db-6a21-46a5-a221-c694bff9d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:28.229645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b18db-6a21-46a5-a221-c694bff9d8aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:28.240834 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b18db-6a21-46a5-a221-c694bff9d8aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:28.242398 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b18db-6a21-46a5-a221-c694bff9d8aa None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:28.264788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-070b18db-6a21-46a5-a221-c694bff9d8aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:28.264788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:28.264788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:28.264788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:28.264788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:28.264788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:28.264788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:28.264788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:28.264788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:28.264788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:28.264788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:28.264788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:28.264788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:27:28.264788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:27:28.264788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:28.265978 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:28.267119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:27:28.267119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:27:28.267119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:28.267119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:28.267119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 429/863] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:28.272309 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080384a-17d8-4715-bcb6-9ae37f9be19c None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:28.380245 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:28.388123 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080384a-17d8-4715-bcb6-9ae37f9be19c None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:28.428523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222835c-dda4-4f83-8ebd-610e5be9ec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:28.429204 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222835c-dda4-4f83-8ebd-610e5be9ec2f None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:28.429570 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222835c-dda4-4f83-8ebd-610e5be9ec2f None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:28.429783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222835c-dda4-4f83-8ebd-610e5be9ec2f None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:28.430571 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222835c-dda4-4f83-8ebd-610e5be9ec2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:28.430814 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222835c-dda4-4f83-8ebd-610e5be9ec2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:28.432276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222835c-dda4-4f83-8ebd-610e5be9ec2f None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:28.444580 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 435/864] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:28.451140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b18db-6a21-46a5-a221-c694bff9d8aa None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:28.540087 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:28.568589 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b18db-6a21-46a5-a221-c694bff9d8aa None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:28.605771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79614f6c-891f-4472-b894-9cda989e2169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:28.606634 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79614f6c-891f-4472-b894-9cda989e2169 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:28.606997 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79614f6c-891f-4472-b894-9cda989e2169 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:28.607283 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79614f6c-891f-4472-b894-9cda989e2169 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:28.617679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79614f6c-891f-4472-b894-9cda989e2169 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:28.619770 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79614f6c-891f-4472-b894-9cda989e2169 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:28.635619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-79614f6c-891f-4472-b894-9cda989e2169 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:27:28.635619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:28.635619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:28.635619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:28.635619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:28.635619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:28.635619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:28.635619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:28.635619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:28.635619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:28.635619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:28.635619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:28.635619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:27:28.635619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:27:28.635619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:28.636742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:28.637847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:27:28.637847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:27:28.637847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:27:28.637847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:27:28.637847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:27:28.637847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:27:28.637847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:27:28.637847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:28.637847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 430/865] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:27:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:28.642786 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222835c-dda4-4f83-8ebd-610e5be9ec2f None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:28.750381 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222835c-dda4-4f83-8ebd-610e5be9ec2f None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:28.787302 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d0c01-ff56-41a0-b682-992f8b4b0785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:28.787961 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d0c01-ff56-41a0-b682-992f8b4b0785 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:28.788252 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d0c01-ff56-41a0-b682-992f8b4b0785 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:28.788525 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d0c01-ff56-41a0-b682-992f8b4b0785 None admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:28.789449 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d0c01-ff56-41a0-b682-992f8b4b0785 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:28.789794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d0c01-ff56-41a0-b682-992f8b4b0785 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:28.791397 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d0c01-ff56-41a0-b682-992f8b4b0785 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:28.805239 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 436/866] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:27:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:27:28.812175 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79614f6c-891f-4472-b894-9cda989e2169 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:28.933783 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79614f6c-891f-4472-b894-9cda989e2169 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:28.971421 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e106d-2022-4620-b502-adaeb5d25c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:28.972430 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e106d-2022-4620-b502-adaeb5d25c8e None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:28.972717 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e106d-2022-4620-b502-adaeb5d25c8e None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:28.972998 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e106d-2022-4620-b502-adaeb5d25c8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:28.973833 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e106d-2022-4620-b502-adaeb5d25c8e None admin] RBAC: Adding query filter params (role.id=0d630eb5fff7436391281167da032c15, scope.project.id=db599cc43051468cbf306faba2431b23, user.id=f716b4b39b3d4547ab937f5a5ffccf08) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:28.974153 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e106d-2022-4620-b502-adaeb5d25c8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:28.975649 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e106d-2022-4620-b502-adaeb5d25c8e None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:28.977506 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:28.982999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 431/867] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:27:28 2022] GET /identity/v3/role_assignments?user.id=f716b4b39b3d4547ab937f5a5ffccf08&scope.project.id=db599cc43051468cbf306faba2431b23&role.id=0d630eb5fff7436391281167da032c15 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:31.441654 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a60815-a24c-4b24-ab9b-b986026db23d None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:31.442198 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a60815-a24c-4b24-ab9b-b986026db23d None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:31.442198 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a60815-a24c-4b24-ab9b-b986026db23d None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:31.443616 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 437/868] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:27:31.450244 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c0309-bbb3-4367-b1d9-ce16c3e87290 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:31.450649 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c0309-bbb3-4367-b1d9-ce16c3e87290 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:31.450811 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c0309-bbb3-4367-b1d9-ce16c3e87290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:31.468063 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-430c0309-bbb3-4367-b1d9-ce16c3e87290 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:27:31.469658 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-430c0309-bbb3-4367-b1d9-ce16c3e87290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:27:31.552799 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 432/869] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:27:31 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:27:31.580229 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a60815-a24c-4b24-ab9b-b986026db23d None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:31.603010 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:31.691410 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a60815-a24c-4b24-ab9b-b986026db23d None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:31.729895 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7584a-9c04-494f-9511-dfe2bd8ca135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:31.730610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7584a-9c04-494f-9511-dfe2bd8ca135 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:31.730913 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7584a-9c04-494f-9511-dfe2bd8ca135 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:31.731205 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7584a-9c04-494f-9511-dfe2bd8ca135 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:31.742823 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7584a-9c04-494f-9511-dfe2bd8ca135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-93d7584a-9c04-494f-9511-dfe2bd8ca135 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:27:31.752278 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:31.753347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:31.754173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:31.754173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:31.754173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:31.754173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:31.754173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:27:31.754173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:27:31.754173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:27:31.754173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:27:31.754173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:27:31.754173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:27:31.754173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:27:31.754173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:31.754173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 438/870] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:27:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 16:27:31.760761 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c0309-bbb3-4367-b1d9-ce16c3e87290 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:31.878690 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c0309-bbb3-4367-b1d9-ce16c3e87290 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:31.910552 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:31.920540 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5df661-d5e6-4f42-9879-793b08de36c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:31.921459 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5df661-d5e6-4f42-9879-793b08de36c8 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:31.921819 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5df661-d5e6-4f42-9879-793b08de36c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:31.922139 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5df661-d5e6-4f42-9879-793b08de36c8 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:31.923074 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5df661-d5e6-4f42-9879-793b08de36c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:31.923480 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5df661-d5e6-4f42-9879-793b08de36c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:31.925185 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5df661-d5e6-4f42-9879-793b08de36c8 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:31.935174 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 433/871] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:27:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:31.941793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7584a-9c04-494f-9511-dfe2bd8ca135 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:32.030925 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:32.055409 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7584a-9c04-494f-9511-dfe2bd8ca135 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:32.093930 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3bf23-0d61-4686-b555-ffe4c0ed60eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:32.094840 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3bf23-0d61-4686-b555-ffe4c0ed60eb None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:32.095170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3bf23-0d61-4686-b555-ffe4c0ed60eb None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:32.095453 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3bf23-0d61-4686-b555-ffe4c0ed60eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:32.107731 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3bf23-0d61-4686-b555-ffe4c0ed60eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:32.109130 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3bf23-0d61-4686-b555-ffe4c0ed60eb None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:32.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-dea3bf23-0d61-4686-b555-ffe4c0ed60eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:32.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:32.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:32.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:32.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:32.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:32.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:32.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:32.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:32.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:32.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:32.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:32.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:27:32.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:27:32.129794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:32.130974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:32.132073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:27:32.132073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:27:32.132073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:32.132073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:32.132073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 439/872] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:32.137583 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5df661-d5e6-4f42-9879-793b08de36c8 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:32.247315 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5df661-d5e6-4f42-9879-793b08de36c8 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:32.284150 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e84ef-d09f-4ed0-9a63-08949b3aa102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:32.284740 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e84ef-d09f-4ed0-9a63-08949b3aa102 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:32.285027 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e84ef-d09f-4ed0-9a63-08949b3aa102 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:32.285304 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e84ef-d09f-4ed0-9a63-08949b3aa102 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:32.286036 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e84ef-d09f-4ed0-9a63-08949b3aa102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:32.286353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e84ef-d09f-4ed0-9a63-08949b3aa102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:32.287770 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e84ef-d09f-4ed0-9a63-08949b3aa102 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:32.300530 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 434/873] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:32.306359 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3bf23-0d61-4686-b555-ffe4c0ed60eb None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:32.412493 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3bf23-0d61-4686-b555-ffe4c0ed60eb None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:32.440252 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:32.450415 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb64479-f58c-4b1f-984a-341a0df46a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:32.451263 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb64479-f58c-4b1f-984a-341a0df46a12 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:32.451551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb64479-f58c-4b1f-984a-341a0df46a12 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:32.451831 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb64479-f58c-4b1f-984a-341a0df46a12 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:32.460215 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb64479-f58c-4b1f-984a-341a0df46a12 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:32.461681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb64479-f58c-4b1f-984a-341a0df46a12 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-5fb64479-f58c-4b1f-984a-341a0df46a12 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:27:32.476972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:32.478192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:32.479443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:32.479443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:32.479443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:27:32.479443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:27:32.479443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:27:32.479443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:27:32.479443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:27:32.479443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:27:32.479443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 16:27:32.479443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:32.479443 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 440/874] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:32.486325 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e84ef-d09f-4ed0-9a63-08949b3aa102 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:32.551242 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:32.608645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e84ef-d09f-4ed0-9a63-08949b3aa102 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:32.643609 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeed3c0-d985-489f-85d5-299a32c886be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:32.644287 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeed3c0-d985-489f-85d5-299a32c886be None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:32.644574 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeed3c0-d985-489f-85d5-299a32c886be None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:32.644847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeed3c0-d985-489f-85d5-299a32c886be None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:32.645678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeed3c0-d985-489f-85d5-299a32c886be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:32.645989 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeed3c0-d985-489f-85d5-299a32c886be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:32.647446 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeed3c0-d985-489f-85d5-299a32c886be None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:32.664737 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 435/875] 10.222.0.86 () {56 vars in 1143 bytes} [Fri Jul 15 16:27:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:32.670540 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb64479-f58c-4b1f-984a-341a0df46a12 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:32.774889 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb64479-f58c-4b1f-984a-341a0df46a12 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:32.809479 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f558c9-426d-49dd-8ab7-6b1a3c9e7752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:32.810054 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f558c9-426d-49dd-8ab7-6b1a3c9e7752 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:32.810341 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f558c9-426d-49dd-8ab7-6b1a3c9e7752 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:32.810624 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f558c9-426d-49dd-8ab7-6b1a3c9e7752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:32.864974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:32.878210 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f558c9-426d-49dd-8ab7-6b1a3c9e7752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:32.879700 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f558c9-426d-49dd-8ab7-6b1a3c9e7752 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:32.974494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 441/876] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:27:32 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 16:27:32.980936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeed3c0-d985-489f-85d5-299a32c886be None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:33.078260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeed3c0-d985-489f-85d5-299a32c886be None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:33.087668 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:33.111515 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e554cdf-dd8b-4985-b408-328c04f64892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:33.112288 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e554cdf-dd8b-4985-b408-328c04f64892 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:33.112570 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e554cdf-dd8b-4985-b408-328c04f64892 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:33.112844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e554cdf-dd8b-4985-b408-328c04f64892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:33.122876 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e554cdf-dd8b-4985-b408-328c04f64892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:33.124308 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e554cdf-dd8b-4985-b408-328c04f64892 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:33.141615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-4e554cdf-dd8b-4985-b408-328c04f64892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:33.141615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:33.141615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:33.141615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:33.141615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:33.141615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:33.141615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:33.141615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:33.141615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:33.141615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:33.141615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:33.141615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:33.141615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:27:33.141615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:27:33.141615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:33.142645 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:33.143707 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:27:33.143707 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:27:33.143707 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:33.143707 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:33.143707 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 436/877] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:33.148484 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f558c9-426d-49dd-8ab7-6b1a3c9e7752 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:33.233028 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:33.245257 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f558c9-426d-49dd-8ab7-6b1a3c9e7752 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:33.277685 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52514a-02d8-4ff8-8954-7001a06d0947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:33.278328 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52514a-02d8-4ff8-8954-7001a06d0947 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:33.278609 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52514a-02d8-4ff8-8954-7001a06d0947 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:33.278896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52514a-02d8-4ff8-8954-7001a06d0947 None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:33.279610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52514a-02d8-4ff8-8954-7001a06d0947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:33.279914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52514a-02d8-4ff8-8954-7001a06d0947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:33.281259 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52514a-02d8-4ff8-8954-7001a06d0947 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:33.292009 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 442/878] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:33.297698 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e554cdf-dd8b-4985-b408-328c04f64892 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:33.393569 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e554cdf-dd8b-4985-b408-328c04f64892 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:33.425196 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871fd14-fe17-457a-ae17-e1d95e9068db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:33.425964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871fd14-fe17-457a-ae17-e1d95e9068db None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:33.426245 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871fd14-fe17-457a-ae17-e1d95e9068db None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:33.426519 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871fd14-fe17-457a-ae17-e1d95e9068db None admin] PATH_INFO: `/v3/projects/service` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:33.433497 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871fd14-fe17-457a-ae17-e1d95e9068db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:33.434950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871fd14-fe17-457a-ae17-e1d95e9068db None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:33.449090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-1871fd14-fe17-457a-ae17-e1d95e9068db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:27:33.449090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:33.449090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:33.449090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:33.449090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:33.449090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:33.449090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:33.449090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:33.449090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:33.449090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:33.449090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:33.449090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:33.449090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:27:33.449090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:27:33.449090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:33.450117 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:33.451218 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:27:33.451218 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:27:33.451218 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:27:33.451218 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:27:33.451218 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:27:33.451218 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:27:33.451218 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:27:33.451218 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:33.451218 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 437/879] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:33.456035 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52514a-02d8-4ff8-8954-7001a06d0947 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:33.565671 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52514a-02d8-4ff8-8954-7001a06d0947 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:33.598207 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d84f6-adaf-41b7-a3b7-c22c9c0b13c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:33.598858 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d84f6-adaf-41b7-a3b7-c22c9c0b13c9 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:33.599175 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d84f6-adaf-41b7-a3b7-c22c9c0b13c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:33.599456 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d84f6-adaf-41b7-a3b7-c22c9c0b13c9 None admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:33.600240 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d84f6-adaf-41b7-a3b7-c22c9c0b13c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:33.600553 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d84f6-adaf-41b7-a3b7-c22c9c0b13c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:33.601977 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d84f6-adaf-41b7-a3b7-c22c9c0b13c9 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:33.614732 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 443/880] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:27:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:33.621461 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871fd14-fe17-457a-ae17-e1d95e9068db None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:33.643779 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:33.719813 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871fd14-fe17-457a-ae17-e1d95e9068db None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:33.752482 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45774818-1c55-4255-b293-c382d1a418f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:33.753120 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45774818-1c55-4255-b293-c382d1a418f3 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:33.753406 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45774818-1c55-4255-b293-c382d1a418f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:33.753686 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45774818-1c55-4255-b293-c382d1a418f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:33.754506 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45774818-1c55-4255-b293-c382d1a418f3 None admin] RBAC: Adding query filter params (role.id=923dd61feaca45d0933a4601fb2c065b, scope.project.id=db599cc43051468cbf306faba2431b23, user.id=f716b4b39b3d4547ab937f5a5ffccf08) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:33.754824 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45774818-1c55-4255-b293-c382d1a418f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:33.756276 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45774818-1c55-4255-b293-c382d1a418f3 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:33.761573 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 438/881] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:27:33 2022] GET /identity/v3/role_assignments?user.id=f716b4b39b3d4547ab937f5a5ffccf08&scope.project.id=db599cc43051468cbf306faba2431b23&role.id=923dd61feaca45d0933a4601fb2c065b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:35.937454 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822d88f-85f4-4188-aea4-840fbbbaf949 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:35.937986 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822d88f-85f4-4188-aea4-840fbbbaf949 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:35.937986 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822d88f-85f4-4188-aea4-840fbbbaf949 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:35.939408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 444/882] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:27:35.944604 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78459e17-de1d-424b-be33-34bcf74fc0be None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:35.944983 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78459e17-de1d-424b-be33-34bcf74fc0be None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:35.945170 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78459e17-de1d-424b-be33-34bcf74fc0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:35.961814 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-78459e17-de1d-424b-be33-34bcf74fc0be None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:27:35.963029 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-78459e17-de1d-424b-be33-34bcf74fc0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:27:36.027414 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 439/883] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:27:35 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:27:36.051795 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822d88f-85f4-4188-aea4-840fbbbaf949 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:36.063305 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:36.152867 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822d88f-85f4-4188-aea4-840fbbbaf949 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:36.185651 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9be13f-37d8-44dd-9890-5bc968e529b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:36.186434 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9be13f-37d8-44dd-9890-5bc968e529b0 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:36.186720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9be13f-37d8-44dd-9890-5bc968e529b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:36.187030 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9be13f-37d8-44dd-9890-5bc968e529b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:36.196850 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9be13f-37d8-44dd-9890-5bc968e529b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-ad9be13f-37d8-44dd-9890-5bc968e529b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:27:36.205044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:36.206081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:36.207291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:36.207291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:36.207291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:36.207291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:36.207291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:27:36.207291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:27:36.207291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:27:36.207291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:27:36.207291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:27:36.207291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:27:36.207291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:27:36.207291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:36.207291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 445/884] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:27:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:36.213058 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78459e17-de1d-424b-be33-34bcf74fc0be None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:36.228400 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:36.308869 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78459e17-de1d-424b-be33-34bcf74fc0be None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:36.341905 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba02615-d065-45a2-8191-192e33488307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:36.342560 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba02615-d065-45a2-8191-192e33488307 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:36.342847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba02615-d065-45a2-8191-192e33488307 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:36.343162 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba02615-d065-45a2-8191-192e33488307 None admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:36.343903 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba02615-d065-45a2-8191-192e33488307 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:36.344215 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba02615-d065-45a2-8191-192e33488307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:36.345577 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba02615-d065-45a2-8191-192e33488307 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:36.353450 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 440/885] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:27:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:36.359126 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9be13f-37d8-44dd-9890-5bc968e529b0 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:36.423262 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:36.456672 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9be13f-37d8-44dd-9890-5bc968e529b0 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:36.489170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc0cfc-3db6-4371-bdf0-4888401e1e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:36.489940 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc0cfc-3db6-4371-bdf0-4888401e1e7c None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:36.490225 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc0cfc-3db6-4371-bdf0-4888401e1e7c None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:36.490500 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc0cfc-3db6-4371-bdf0-4888401e1e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:36.501473 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc0cfc-3db6-4371-bdf0-4888401e1e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:36.503177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc0cfc-3db6-4371-bdf0-4888401e1e7c None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:36.522036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-fabc0cfc-3db6-4371-bdf0-4888401e1e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:36.522036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:36.522036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:36.522036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:36.522036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:36.522036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:36.522036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:36.522036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:36.522036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:36.522036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:36.522036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:36.522036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:36.522036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:27:36.522036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:27:36.522036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:36.523332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:36.524621 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:27:36.524621 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:27:36.524621 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:36.524621 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:36.524621 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 446/886] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:36.529953 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba02615-d065-45a2-8191-192e33488307 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:36.623006 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:36.645176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba02615-d065-45a2-8191-192e33488307 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:36.677520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83741cf2-4cdd-4670-bc98-df2a4f509996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:36.678107 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83741cf2-4cdd-4670-bc98-df2a4f509996 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:36.678393 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83741cf2-4cdd-4670-bc98-df2a4f509996 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:36.678672 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83741cf2-4cdd-4670-bc98-df2a4f509996 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:36.679424 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83741cf2-4cdd-4670-bc98-df2a4f509996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:36.679736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83741cf2-4cdd-4670-bc98-df2a4f509996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:36.681877 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83741cf2-4cdd-4670-bc98-df2a4f509996 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:36.693313 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 441/887] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:36.699270 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc0cfc-3db6-4371-bdf0-4888401e1e7c None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:36.795149 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc0cfc-3db6-4371-bdf0-4888401e1e7c None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:36.814307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:36.828316 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b003a-9087-49b8-9bec-793126c53c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:36.829090 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b003a-9087-49b8-9bec-793126c53c6d None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:36.829372 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b003a-9087-49b8-9bec-793126c53c6d None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:36.829643 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b003a-9087-49b8-9bec-793126c53c6d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:36.836843 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b003a-9087-49b8-9bec-793126c53c6d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:36.838262 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b003a-9087-49b8-9bec-793126c53c6d None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-5d3b003a-9087-49b8-9bec-793126c53c6d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:27:36.852080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:36.853623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:36.854681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:36.854681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:36.854681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:27:36.854681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:27:36.854681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:27:36.854681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:27:36.854681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:27:36.854681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:27:36.854681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 16:27:36.854681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:36.854681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 447/888] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:36.859541 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83741cf2-4cdd-4670-bc98-df2a4f509996 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:36.955492 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83741cf2-4cdd-4670-bc98-df2a4f509996 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:36.989374 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2af31-3642-4704-9096-2fb61c45f416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:36.990038 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2af31-3642-4704-9096-2fb61c45f416 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:36.990324 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2af31-3642-4704-9096-2fb61c45f416 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:36.990599 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2af31-3642-4704-9096-2fb61c45f416 None admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:36.991457 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2af31-3642-4704-9096-2fb61c45f416 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:36.991770 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2af31-3642-4704-9096-2fb61c45f416 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:36.993185 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2af31-3642-4704-9096-2fb61c45f416 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:36.995783 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:37.010705 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 442/889] 10.222.0.86 () {56 vars in 1143 bytes} [Fri Jul 15 16:27:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:37.016370 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b003a-9087-49b8-9bec-793126c53c6d None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:37.112460 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b003a-9087-49b8-9bec-793126c53c6d None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:37.143573 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf5a43-ca57-4033-a7de-8ef89f856cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:37.144333 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf5a43-ca57-4033-a7de-8ef89f856cbf None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:37.144615 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf5a43-ca57-4033-a7de-8ef89f856cbf None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:37.144889 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf5a43-ca57-4033-a7de-8ef89f856cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:37.155427 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf5a43-ca57-4033-a7de-8ef89f856cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:37.156846 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf5a43-ca57-4033-a7de-8ef89f856cbf None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:37.173680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-e1cf5a43-ca57-4033-a7de-8ef89f856cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:37.173680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:37.173680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:37.173680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:37.173680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:37.173680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:37.173680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:37.173680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:37.173680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:37.173680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:37.173680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:37.173680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:37.173680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:27:37.173680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:27:37.173680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:37.174717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:37.175830 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:27:37.175830 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:27:37.175830 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:37.175830 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:37.175830 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 448/890] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:37.180351 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2af31-3642-4704-9096-2fb61c45f416 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:37.279039 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2af31-3642-4704-9096-2fb61c45f416 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:37.311973 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de2538-b321-438b-a7d2-b12e1fb68e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:37.312618 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de2538-b321-438b-a7d2-b12e1fb68e05 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:37.312899 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de2538-b321-438b-a7d2-b12e1fb68e05 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:37.313172 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de2538-b321-438b-a7d2-b12e1fb68e05 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:37.313883 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de2538-b321-438b-a7d2-b12e1fb68e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:37.314189 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de2538-b321-438b-a7d2-b12e1fb68e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:37.315569 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de2538-b321-438b-a7d2-b12e1fb68e05 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:37.326520 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 443/891] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:37.332203 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf5a43-ca57-4033-a7de-8ef89f856cbf None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:37.363993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:37.429801 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf5a43-ca57-4033-a7de-8ef89f856cbf None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:37.461778 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291b13a-f558-4162-9500-c5fbfde4d677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:37.462539 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b13a-f558-4162-9500-c5fbfde4d677 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:37.462822 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b13a-f558-4162-9500-c5fbfde4d677 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:37.463129 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b13a-f558-4162-9500-c5fbfde4d677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:37.469455 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291b13a-f558-4162-9500-c5fbfde4d677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:37.470878 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291b13a-f558-4162-9500-c5fbfde4d677 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:37.485002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-6291b13a-f558-4162-9500-c5fbfde4d677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:27:37.485002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:37.485002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:37.485002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:37.485002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:37.485002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:37.485002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:37.485002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:37.485002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:37.485002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:37.485002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:37.485002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:37.485002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:27:37.485002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:27:37.485002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:37.486066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:37.487300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:27:37.487300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:27:37.487300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:27:37.487300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:27:37.487300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:27:37.487300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:27:37.487300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:27:37.487300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:37.487300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 449/892] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:27:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:37.491894 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de2538-b321-438b-a7d2-b12e1fb68e05 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:37.552751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:37.596766 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de2538-b321-438b-a7d2-b12e1fb68e05 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:37.630343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d144c7a-bcf9-468b-bcee-f879c3144b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:37.631030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d144c7a-bcf9-468b-bcee-f879c3144b81 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:37.631320 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d144c7a-bcf9-468b-bcee-f879c3144b81 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:37.631606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d144c7a-bcf9-468b-bcee-f879c3144b81 None admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:37.632390 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d144c7a-bcf9-468b-bcee-f879c3144b81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:37.632706 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d144c7a-bcf9-468b-bcee-f879c3144b81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:37.634165 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d144c7a-bcf9-468b-bcee-f879c3144b81 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:37.645965 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 444/893] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:27:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:37.652566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291b13a-f558-4162-9500-c5fbfde4d677 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:37.741113 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:37.750335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291b13a-f558-4162-9500-c5fbfde4d677 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:37.783942 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e0a2b-593d-4d36-bcc1-b966681370e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:37.784802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e0a2b-593d-4d36-bcc1-b966681370e1 None admin] REQUEST_METHOD: `PUT` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:37.785085 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e0a2b-593d-4d36-bcc1-b966681370e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:37.785363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e0a2b-593d-4d36-bcc1-b966681370e1 None admin] PATH_INFO: `/v3/projects/db599cc43051468cbf306faba2431b23/users/f716b4b39b3d4547ab937f5a5ffccf08/roles/923dd61feaca45d0933a4601fb2c065b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:37.787315 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e0a2b-593d-4d36-bcc1-b966681370e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=db599cc43051468cbf306faba2431b23, user_id=f716b4b39b3d4547ab937f5a5ffccf08, role_id=923dd61feaca45d0933a4601fb2c065b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:37.788737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e0a2b-593d-4d36-bcc1-b966681370e1 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:37.800816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 450/894] 10.222.0.86 () {58 vars in 1439 bytes} [Fri Jul 15 16:27:37 2022] PUT /identity/v3/projects/db599cc43051468cbf306faba2431b23/users/f716b4b39b3d4547ab937f5a5ffccf08/roles/923dd61feaca45d0933a4601fb2c065b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:27:39.988921 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c8ced-6744-4a37-be5a-39a116bddf34 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:39.989432 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c8ced-6744-4a37-be5a-39a116bddf34 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:39.989522 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c8ced-6744-4a37-be5a-39a116bddf34 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:39.990839 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 445/895] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:27:39.996553 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105706e-e98f-440d-a44a-c59e04ba8f91 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:39.996972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105706e-e98f-440d-a44a-c59e04ba8f91 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:39.997118 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105706e-e98f-440d-a44a-c59e04ba8f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:40.014214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-6105706e-e98f-440d-a44a-c59e04ba8f91 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:27:40.015439 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-6105706e-e98f-440d-a44a-c59e04ba8f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:27:40.081470 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 451/896] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:27:39 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:27:40.105134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c8ced-6744-4a37-be5a-39a116bddf34 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:40.203523 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c8ced-6744-4a37-be5a-39a116bddf34 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:40.217208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:40.237029 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4937694-0061-426d-baf5-68eb2f7f3f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:40.237818 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4937694-0061-426d-baf5-68eb2f7f3f95 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:40.238103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4937694-0061-426d-baf5-68eb2f7f3f95 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:40.238381 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4937694-0061-426d-baf5-68eb2f7f3f95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:40.248886 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4937694-0061-426d-baf5-68eb2f7f3f95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-e4937694-0061-426d-baf5-68eb2f7f3f95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 16:27:40.256572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:40.257671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:40.259340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:40.259340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:40.259340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:40.259340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:40.259340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 16:27:40.259340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 16:27:40.259340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 16:27:40.259340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 16:27:40.259340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 16:27:40.259340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 16:27:40.259340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 16:27:40.259340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:40.259340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 446/897] 10.222.0.86 () {56 vars in 1096 bytes} [Fri Jul 15 16:27:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:40.264324 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105706e-e98f-440d-a44a-c59e04ba8f91 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:40.340621 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:40.360079 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105706e-e98f-440d-a44a-c59e04ba8f91 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:40.392526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e3ebf-fcef-4904-a516-9c7bcf68c331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:40.393181 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e3ebf-fcef-4904-a516-9c7bcf68c331 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:40.393466 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e3ebf-fcef-4904-a516-9c7bcf68c331 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:40.393741 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e3ebf-fcef-4904-a516-9c7bcf68c331 None admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:40.394475 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e3ebf-fcef-4904-a516-9c7bcf68c331 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:40.394779 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e3ebf-fcef-4904-a516-9c7bcf68c331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:40.396156 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e3ebf-fcef-4904-a516-9c7bcf68c331 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:40.403961 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 452/898] 10.222.0.86 () {56 vars in 1099 bytes} [Fri Jul 15 16:27:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:40.409598 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4937694-0061-426d-baf5-68eb2f7f3f95 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:40.510524 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4937694-0061-426d-baf5-68eb2f7f3f95 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:40.548990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ba08a-3bfc-4b91-b419-5fac91d88ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:40.549860 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ba08a-3bfc-4b91-b419-5fac91d88ae4 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:40.550174 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ba08a-3bfc-4b91-b419-5fac91d88ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:40.550651 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ba08a-3bfc-4b91-b419-5fac91d88ae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:40.565056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ba08a-3bfc-4b91-b419-5fac91d88ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:40.566697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ba08a-3bfc-4b91-b419-5fac91d88ae4 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:40.586098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-047ba08a-3bfc-4b91-b419-5fac91d88ae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:40.586098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:40.586098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:40.586098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:40.586098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:40.586098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:40.586098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:40.586098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:40.586098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:40.586098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:40.586098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:40.586098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:40.586098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:27:40.586098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:27:40.586098 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:40.588008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:40.588959 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:27:40.588959 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:27:40.588959 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:40.588959 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:40.588959 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 447/899] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:40.594520 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e3ebf-fcef-4904-a516-9c7bcf68c331 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:40.690585 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e3ebf-fcef-4904-a516-9c7bcf68c331 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:40.723023 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0bf47-939f-4e68-8f67-e0954b811455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:40.723666 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0bf47-939f-4e68-8f67-e0954b811455 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:40.723945 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0bf47-939f-4e68-8f67-e0954b811455 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:40.724220 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0bf47-939f-4e68-8f67-e0954b811455 None admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:40.724924 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0bf47-939f-4e68-8f67-e0954b811455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:40.725227 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0bf47-939f-4e68-8f67-e0954b811455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:40.726578 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0bf47-939f-4e68-8f67-e0954b811455 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:40.737756 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 453/900] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:40.743959 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ba08a-3bfc-4b91-b419-5fac91d88ae4 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:40.771796 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:40.843644 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ba08a-3bfc-4b91-b419-5fac91d88ae4 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:40.881454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fbc0a-1fe9-45a3-9df9-9d2993661489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:40.882251 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fbc0a-1fe9-45a3-9df9-9d2993661489 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:40.882534 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fbc0a-1fe9-45a3-9df9-9d2993661489 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:40.882812 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fbc0a-1fe9-45a3-9df9-9d2993661489 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:40.890497 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fbc0a-1fe9-45a3-9df9-9d2993661489 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:40.891968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fbc0a-1fe9-45a3-9df9-9d2993661489 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-dc2fbc0a-1fe9-45a3-9df9-9d2993661489 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 16:27:40.906386 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:40.907546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:40.908856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:40.908856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:40.908856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 16:27:40.908856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 16:27:40.908856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 16:27:40.908856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 16:27:40.908856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 16:27:40.908856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 16:27:40.908856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 16:27:40.908856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:40.908856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 448/901] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:40.913347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0bf47-939f-4e68-8f67-e0954b811455 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:40.917826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:41.013163 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0bf47-939f-4e68-8f67-e0954b811455 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:41.045702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48a36d-8584-4702-b23c-2012190b1399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:41.046323 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48a36d-8584-4702-b23c-2012190b1399 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:41.046604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48a36d-8584-4702-b23c-2012190b1399 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:41.046900 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48a36d-8584-4702-b23c-2012190b1399 None admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:41.047721 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48a36d-8584-4702-b23c-2012190b1399 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:41.048027 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48a36d-8584-4702-b23c-2012190b1399 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:41.049438 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48a36d-8584-4702-b23c-2012190b1399 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:41.066021 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 454/902] 10.222.0.86 () {56 vars in 1143 bytes} [Fri Jul 15 16:27:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:41.071786 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fbc0a-1fe9-45a3-9df9-9d2993661489 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:41.154611 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:41.169454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fbc0a-1fe9-45a3-9df9-9d2993661489 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:41.202094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb695f74-2798-4fce-9d23-dd377ea86ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:41.202730 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb695f74-2798-4fce-9d23-dd377ea86ef1 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:41.203051 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb695f74-2798-4fce-9d23-dd377ea86ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:41.203335 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb695f74-2798-4fce-9d23-dd377ea86ef1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:41.268320 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb695f74-2798-4fce-9d23-dd377ea86ef1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:41.269747 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb695f74-2798-4fce-9d23-dd377ea86ef1 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:41.348427 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:41.364494 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 449/903] 10.222.0.86 () {58 vars in 1282 bytes} [Fri Jul 15 16:27:41 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 16:27:41.371274 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48a36d-8584-4702-b23c-2012190b1399 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:41.429341 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:41.466231 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48a36d-8584-4702-b23c-2012190b1399 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:41.498677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209120fc-ab2e-4b8f-977a-1609b97d44db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:41.499470 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209120fc-ab2e-4b8f-977a-1609b97d44db None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:41.499757 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209120fc-ab2e-4b8f-977a-1609b97d44db None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:41.500175 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209120fc-ab2e-4b8f-977a-1609b97d44db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:41.513459 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209120fc-ab2e-4b8f-977a-1609b97d44db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:41.515359 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209120fc-ab2e-4b8f-977a-1609b97d44db None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:41.534984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-209120fc-ab2e-4b8f-977a-1609b97d44db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:41.534984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:41.534984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:41.534984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:41.534984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:41.534984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:41.534984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:41.534984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:41.534984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:41.534984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:41.534984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:41.534984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:41.534984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 16:27:41.534984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 16:27:41.534984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:41.536078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:41.537190 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 16:27:41.537190 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 16:27:41.537190 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 16:27:41.537190 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:41.537190 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 455/904] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:41.543137 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb695f74-2798-4fce-9d23-dd377ea86ef1 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:41.637769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb695f74-2798-4fce-9d23-dd377ea86ef1 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:41.671846 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c271294-2c6a-468a-83de-e2e25560f821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:41.672490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c271294-2c6a-468a-83de-e2e25560f821 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:41.672770 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c271294-2c6a-468a-83de-e2e25560f821 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:41.673042 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c271294-2c6a-468a-83de-e2e25560f821 None admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:41.673744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c271294-2c6a-468a-83de-e2e25560f821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:41.674046 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c271294-2c6a-468a-83de-e2e25560f821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:41.675417 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c271294-2c6a-468a-83de-e2e25560f821 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:41.686289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 450/905] 10.222.0.86 () {56 vars in 1109 bytes} [Fri Jul 15 16:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:41.692009 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209120fc-ab2e-4b8f-977a-1609b97d44db None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:41.788216 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209120fc-ab2e-4b8f-977a-1609b97d44db None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:41.801523 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:41.821481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b364574-3f0d-4018-a74a-fb2e301e94fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:41.822261 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b364574-3f0d-4018-a74a-fb2e301e94fe None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:41.822590 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b364574-3f0d-4018-a74a-fb2e301e94fe None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:41.822884 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b364574-3f0d-4018-a74a-fb2e301e94fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:41.829509 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b364574-3f0d-4018-a74a-fb2e301e94fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:41.830950 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b364574-3f0d-4018-a74a-fb2e301e94fe None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:41.844854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application [None req-2b364574-3f0d-4018-a74a-fb2e301e94fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:27:41.844854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:41.844854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:41.844854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:41.844854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:41.844854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:41.844854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:41.844854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:41.844854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:41.844854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:41.844854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:41.844854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:41.844854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 16:27:41.844854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 16:27:41.844854 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:41.845875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:41.847002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 16:27:41.847002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 16:27:41.847002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 16:27:41.847002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 16:27:41.847002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 16:27:41.847002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 16:27:41.847002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 16:27:41.847002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: ERROR keystone.server.flask.application Jul 15 16:27:41.847002 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 456/906] 10.222.0.86 () {56 vars in 1111 bytes} [Fri Jul 15 16:27:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:41.852552 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c271294-2c6a-468a-83de-e2e25560f821 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:41.897798 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:41.949560 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c271294-2c6a-468a-83de-e2e25560f821 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:41.981851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bcbc3-175d-4f8a-aeae-785ee90202cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:41.982514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bcbc3-175d-4f8a-aeae-785ee90202cc None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:41.982837 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bcbc3-175d-4f8a-aeae-785ee90202cc None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:41.983104 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bcbc3-175d-4f8a-aeae-785ee90202cc None admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:41.983980 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bcbc3-175d-4f8a-aeae-785ee90202cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:41.984282 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bcbc3-175d-4f8a-aeae-785ee90202cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:41.985711 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bcbc3-175d-4f8a-aeae-785ee90202cc None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:41.997479 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 451/907] 10.222.0.86 () {56 vars in 1148 bytes} [Fri Jul 15 16:27:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:42.003711 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b364574-3f0d-4018-a74a-fb2e301e94fe None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:42.101092 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b364574-3f0d-4018-a74a-fb2e301e94fe None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:42.134888 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec257b9e-6548-4bfa-a481-cce049fcf2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:42.135525 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec257b9e-6548-4bfa-a481-cce049fcf2d7 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:42.135806 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec257b9e-6548-4bfa-a481-cce049fcf2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:42.136079 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec257b9e-6548-4bfa-a481-cce049fcf2d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:42.136900 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec257b9e-6548-4bfa-a481-cce049fcf2d7 None admin] RBAC: Adding query filter params (role.id=923dd61feaca45d0933a4601fb2c065b, scope.project.id=db599cc43051468cbf306faba2431b23, user.id=f716b4b39b3d4547ab937f5a5ffccf08) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:42.137212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec257b9e-6548-4bfa-a481-cce049fcf2d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:42.138625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec257b9e-6548-4bfa-a481-cce049fcf2d7 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:42.144273 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 457/908] 10.222.0.86 () {56 vars in 1374 bytes} [Fri Jul 15 16:27:42 2022] GET /identity/v3/role_assignments?user.id=f716b4b39b3d4547ab937f5a5ffccf08&scope.project.id=db599cc43051468cbf306faba2431b23&role.id=923dd61feaca45d0933a4601fb2c065b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:44.348565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53388d6-515a-4959-af8d-891e1b614e5e None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:44.349113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53388d6-515a-4959-af8d-891e1b614e5e None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:44.349113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53388d6-515a-4959-af8d-891e1b614e5e None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:44.350492 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 452/909] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:27:44.356076 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2d872-a859-4be6-abaf-1c87517c79df None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:44.356457 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2d872-a859-4be6-abaf-1c87517c79df None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:44.356629 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2d872-a859-4be6-abaf-1c87517c79df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:44.373372 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-b7a2d872-a859-4be6-abaf-1c87517c79df None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:27:44.374553 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-b7a2d872-a859-4be6-abaf-1c87517c79df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:27:44.402786 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:44.439664 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 458/910] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:27:44 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:27:44.463228 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53388d6-515a-4959-af8d-891e1b614e5e None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:44.569269 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53388d6-515a-4959-af8d-891e1b614e5e None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:44.578448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:44.607595 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d311b8-b047-4212-b3d0-8049a88b5ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:44.608320 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d311b8-b047-4212-b3d0-8049a88b5ad4 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:44.608603 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d311b8-b047-4212-b3d0-8049a88b5ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:44.608877 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d311b8-b047-4212-b3d0-8049a88b5ad4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:44.609527 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d311b8-b047-4212-b3d0-8049a88b5ad4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:44.610890 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d311b8-b047-4212-b3d0-8049a88b5ad4 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-b7d311b8-b047-4212-b3d0-8049a88b5ad4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:44.622925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:44.623990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:44.624911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:44.624911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:44.624911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:44.624911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:44.624911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:44.624911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:44.624911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:44.624911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:44.624911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:44.624911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:44.624911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:27:44.624911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:27:44.624911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 16:27:44.624911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:44.624911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 453/911] 10.222.0.86 () {56 vars in 1117 bytes} [Fri Jul 15 16:27:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:44.630097 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2d872-a859-4be6-abaf-1c87517c79df None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:44.727240 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2d872-a859-4be6-abaf-1c87517c79df None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:44.760104 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cd15b-dd8f-415a-bc27-8c7ef2a928c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:44.760778 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cd15b-dd8f-415a-bc27-8c7ef2a928c7 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:44.761059 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cd15b-dd8f-415a-bc27-8c7ef2a928c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:44.761334 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cd15b-dd8f-415a-bc27-8c7ef2a928c7 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:44.762034 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cd15b-dd8f-415a-bc27-8c7ef2a928c7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:44.762340 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cd15b-dd8f-415a-bc27-8c7ef2a928c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:44.763719 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cd15b-dd8f-415a-bc27-8c7ef2a928c7 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:44.768320 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 459/912] 10.222.0.86 () {56 vars in 1116 bytes} [Fri Jul 15 16:27:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:44.773940 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d311b8-b047-4212-b3d0-8049a88b5ad4 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:44.870799 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d311b8-b047-4212-b3d0-8049a88b5ad4 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:44.902859 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a3ee4-a2c0-41d3-a5a4-82834460d691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:44.903535 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a3ee4-a2c0-41d3-a5a4-82834460d691 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:44.903821 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a3ee4-a2c0-41d3-a5a4-82834460d691 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:44.904097 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a3ee4-a2c0-41d3-a5a4-82834460d691 None admin] PATH_INFO: `/v3/services` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:44.904792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a3ee4-a2c0-41d3-a5a4-82834460d691 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:44.905104 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a3ee4-a2c0-41d3-a5a4-82834460d691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:44.906457 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a3ee4-a2c0-41d3-a5a4-82834460d691 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:44.910787 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 454/913] 10.222.0.86 () {56 vars in 1116 bytes} [Fri Jul 15 16:27:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:47.121479 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a311f22-ce93-47f3-a006-a9f2239d4703 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:47.121978 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a311f22-ce93-47f3-a006-a9f2239d4703 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:47.121978 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a311f22-ce93-47f3-a006-a9f2239d4703 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:47.123353 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 460/914] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:27:47.128537 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb3517-d367-4d61-81fb-6fd83e32850b None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:47.128949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb3517-d367-4d61-81fb-6fd83e32850b None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:47.129119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb3517-d367-4d61-81fb-6fd83e32850b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:47.145350 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-48fb3517-d367-4d61-81fb-6fd83e32850b None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:27:47.146524 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-48fb3517-d367-4d61-81fb-6fd83e32850b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:27:47.172236 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:47.210788 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 455/915] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:27:47 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:27:47.234556 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a311f22-ce93-47f3-a006-a9f2239d4703 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:47.265680 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:47.333534 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a311f22-ce93-47f3-a006-a9f2239d4703 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:47.366321 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e508d34-90b2-4c17-b2a7-5bee77ed36ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:47.366997 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e508d34-90b2-4c17-b2a7-5bee77ed36ee None admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:47.367283 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e508d34-90b2-4c17-b2a7-5bee77ed36ee None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:47.367562 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e508d34-90b2-4c17-b2a7-5bee77ed36ee None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:47.368271 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e508d34-90b2-4c17-b2a7-5bee77ed36ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:47.369647 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e508d34-90b2-4c17-b2a7-5bee77ed36ee None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:47.382351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 461/916] 10.222.0.86 () {60 vars in 1141 bytes} [Fri Jul 15 16:27:47 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 16:27:49.607785 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b370d-8ddb-4adb-93f8-6f650f28fcf5 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:49.608421 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b370d-8ddb-4adb-93f8-6f650f28fcf5 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:49.608421 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b370d-8ddb-4adb-93f8-6f650f28fcf5 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:49.609776 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 456/917] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:27:49.615664 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3359b79-d4f4-41c1-9580-f72b82d5a1c9 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:49.616088 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3359b79-d4f4-41c1-9580-f72b82d5a1c9 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:49.616474 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3359b79-d4f4-41c1-9580-f72b82d5a1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:49.634517 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-e3359b79-d4f4-41c1-9580-f72b82d5a1c9 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:27:49.636300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-e3359b79-d4f4-41c1-9580-f72b82d5a1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:27:49.706418 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 462/918] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:27:49 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:27:49.733032 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b370d-8ddb-4adb-93f8-6f650f28fcf5 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:49.831412 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b370d-8ddb-4adb-93f8-6f650f28fcf5 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:49.866928 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53311c29-8aa2-4599-a453-b55c3e63f5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:49.867723 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53311c29-8aa2-4599-a453-b55c3e63f5d9 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:49.868006 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53311c29-8aa2-4599-a453-b55c3e63f5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:49.868282 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53311c29-8aa2-4599-a453-b55c3e63f5d9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:49.868942 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53311c29-8aa2-4599-a453-b55c3e63f5d9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:49.870289 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53311c29-8aa2-4599-a453-b55c3e63f5d9 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-53311c29-8aa2-4599-a453-b55c3e63f5d9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:49.881948 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:49.883171 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:49.884225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:49.884225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:49.884225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:49.884225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:49.884225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:49.884225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:49.884225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:49.884225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:49.884225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:49.884225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:49.884225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:27:49.884225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:27:49.884225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 16:27:49.884225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:49.884225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 457/919] 10.222.0.86 () {56 vars in 1117 bytes} [Fri Jul 15 16:27:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:49.889201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3359b79-d4f4-41c1-9580-f72b82d5a1c9 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:49.907262 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:49.986943 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3359b79-d4f4-41c1-9580-f72b82d5a1c9 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:50.019716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b20cd4-9b4a-4517-a92c-473f7d1a37e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:50.020366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b20cd4-9b4a-4517-a92c-473f7d1a37e6 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:50.020653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b20cd4-9b4a-4517-a92c-473f7d1a37e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:50.020952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b20cd4-9b4a-4517-a92c-473f7d1a37e6 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:50.021773 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b20cd4-9b4a-4517-a92c-473f7d1a37e6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:50.022080 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b20cd4-9b4a-4517-a92c-473f7d1a37e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:50.023481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b20cd4-9b4a-4517-a92c-473f7d1a37e6 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:50.029089 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 463/920] 10.222.0.86 () {56 vars in 1116 bytes} [Fri Jul 15 16:27:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:50.035058 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53311c29-8aa2-4599-a453-b55c3e63f5d9 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:50.063668 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:50.133547 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53311c29-8aa2-4599-a453-b55c3e63f5d9 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:50.168221 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e2daf-30ca-433a-ab5d-fd0a8064c547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:50.168875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e2daf-30ca-433a-ab5d-fd0a8064c547 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:50.169163 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e2daf-30ca-433a-ab5d-fd0a8064c547 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:50.169443 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e2daf-30ca-433a-ab5d-fd0a8064c547 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:50.170238 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e2daf-30ca-433a-ab5d-fd0a8064c547 None admin] RBAC: Adding query filter params (interface=public, service_id=1c6472bf7e264631bfc3265fb686f1db, region_id=RegionOne) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:50.170556 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e2daf-30ca-433a-ab5d-fd0a8064c547 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:50.171955 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e2daf-30ca-433a-ab5d-fd0a8064c547 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:50.176968 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 458/921] 10.222.0.86 () {56 vars in 1251 bytes} [Fri Jul 15 16:27:50 2022] GET /identity/v3/endpoints?service_id=1c6472bf7e264631bfc3265fb686f1db&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:50.182743 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b20cd4-9b4a-4517-a92c-473f7d1a37e6 None admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:50.261288 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:50.279393 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b20cd4-9b4a-4517-a92c-473f7d1a37e6 None admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:50.313031 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a99cf3-e63c-483f-9f66-4530c152cab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:50.313689 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a99cf3-e63c-483f-9f66-4530c152cab0 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:50.313974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a99cf3-e63c-483f-9f66-4530c152cab0 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:50.314250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a99cf3-e63c-483f-9f66-4530c152cab0 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:50.314956 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a99cf3-e63c-483f-9f66-4530c152cab0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:50.316310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a99cf3-e63c-483f-9f66-4530c152cab0 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:50.323623 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 464/922] 10.222.0.86 () {56 vars in 1087 bytes} [Fri Jul 15 16:27:50 2022] GET /identity/v3/services => generated 1962 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 16:27:52.564048 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09334e-4f37-4544-abeb-29c97444051d None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:52.564576 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09334e-4f37-4544-abeb-29c97444051d None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:52.564664 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09334e-4f37-4544-abeb-29c97444051d None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:52.565963 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 459/923] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:27:52.571149 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876cb2b-dc4a-4b4b-a870-80dd57d5d4eb None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:52.571518 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876cb2b-dc4a-4b4b-a870-80dd57d5d4eb None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:52.571700 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876cb2b-dc4a-4b4b-a870-80dd57d5d4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:52.589192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-5876cb2b-dc4a-4b4b-a870-80dd57d5d4eb None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:27:52.590364 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-5876cb2b-dc4a-4b4b-a870-80dd57d5d4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:27:52.654298 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 465/924] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:27:52 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 16:27:52.678001 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09334e-4f37-4544-abeb-29c97444051d None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:52.767615 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:52.777502 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09334e-4f37-4544-abeb-29c97444051d None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:52.809783 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11c013-2e3d-4642-8ad6-54cc68e0bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:52.810558 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c013-2e3d-4642-8ad6-54cc68e0bc68 None admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:52.810841 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c013-2e3d-4642-8ad6-54cc68e0bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:52.811153 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c013-2e3d-4642-8ad6-54cc68e0bc68 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:52.811794 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11c013-2e3d-4642-8ad6-54cc68e0bc68 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:52.813146 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11c013-2e3d-4642-8ad6-54cc68e0bc68 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application [None req-8a11c013-2e3d-4642-8ad6-54cc68e0bc68 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 16:27:52.825580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 16:27:52.826739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 16:27:52.827804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 16:27:52.827804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application with Lock( Jul 15 16:27:52.827804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 16:27:52.827804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self._enter() Jul 15 16:27:52.827804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 16:27:52.827804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 16:27:52.827804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 16:27:52.827804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application return self.creator() Jul 15 16:27:52.827804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 16:27:52.827804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application created_value = creator( Jul 15 16:27:52.827804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 16:27:52.827804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 16:27:52.827804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 16:27:52.827804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: ERROR keystone.server.flask.application Jul 15 16:27:52.831010 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 460/925] 10.222.0.86 () {56 vars in 1117 bytes} [Fri Jul 15 16:27:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 16:27:52.832583 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876cb2b-dc4a-4b4b-a870-80dd57d5d4eb None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:52.907111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:27:52.929564 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876cb2b-dc4a-4b4b-a870-80dd57d5d4eb None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:52.962908 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adad376-80c4-4e9f-bf44-99684ff44be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:52.963571 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adad376-80c4-4e9f-bf44-99684ff44be5 None admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:52.963856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adad376-80c4-4e9f-bf44-99684ff44be5 None admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:52.964130 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adad376-80c4-4e9f-bf44-99684ff44be5 None admin] PATH_INFO: `/v3/services` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:52.964829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adad376-80c4-4e9f-bf44-99684ff44be5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:27:52.965136 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adad376-80c4-4e9f-bf44-99684ff44be5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:52.966494 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adad376-80c4-4e9f-bf44-99684ff44be5 None admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:52.971435 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 466/926] 10.222.0.86 () {56 vars in 1116 bytes} [Fri Jul 15 16:27:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:27:52.977327 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11c013-2e3d-4642-8ad6-54cc68e0bc68 None admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:27:53.072991 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11c013-2e3d-4642-8ad6-54cc68e0bc68 None admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:27:53.105477 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671012d-a8f8-4b7e-aeb0-4a1668a2abf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:27:53.106047 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671012d-a8f8-4b7e-aeb0-4a1668a2abf6 None admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:27:53.106330 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671012d-a8f8-4b7e-aeb0-4a1668a2abf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:27:53.106608 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671012d-a8f8-4b7e-aeb0-4a1668a2abf6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:27:53.107404 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671012d-a8f8-4b7e-aeb0-4a1668a2abf6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:27:53.108749 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671012d-a8f8-4b7e-aeb0-4a1668a2abf6 None admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:27:53.127043 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 461/927] 10.222.0.86 () {60 vars in 1144 bytes} [Fri Jul 15 16:27:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:28:02.968537 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=30 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:28:03.123499 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:28:51.316777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd6eb0-cb91-4f9d-80ff-3ab12989f314 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:28:51.317311 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd6eb0-cb91-4f9d-80ff-3ab12989f314 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:28:51.317311 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd6eb0-cb91-4f9d-80ff-3ab12989f314 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:28:51.318709 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 467/928] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:28:51.325530 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c9862-bbe6-430c-b30b-c27a6fa992e6 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:28:51.326030 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c9862-bbe6-430c-b30b-c27a6fa992e6 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:28:51.326137 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c9862-bbe6-430c-b30b-c27a6fa992e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:28:51.345177 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-c90c9862-bbe6-430c-b30b-c27a6fa992e6 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:28:51.347217 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-c90c9862-bbe6-430c-b30b-c27a6fa992e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:28:51.448246 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 462/929] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:28:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:28:51.512310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f705319-f3e5-4ead-8ac0-5a7f638d9454 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:28:51.512808 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f705319-f3e5-4ead-8ac0-5a7f638d9454 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:28:51.513097 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f705319-f3e5-4ead-8ac0-5a7f638d9454 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:28:51.514613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 468/930] 10.222.0.86 () {54 vars in 964 bytes} [Fri Jul 15 16:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:28:51.529338 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4d15-362c-4147-95c7-55edcd7b8419 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:28:51.530402 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4d15-362c-4147-95c7-55edcd7b8419 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:28:51.531435 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4d15-362c-4147-95c7-55edcd7b8419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:28:51.618817 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-240c4d15-362c-4147-95c7-55edcd7b8419 None None] MFA Rules not processed for user `8e620f2a895241279b63327d6a7d3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:28:51.620040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-240c4d15-362c-4147-95c7-55edcd7b8419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:28:51.696725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 463/931] 10.222.0.86 () {58 vars in 1061 bytes} [Fri Jul 15 16:28:51 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:28:51.705588 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f705319-f3e5-4ead-8ac0-5a7f638d9454 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:28:51.717571 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f705319-f3e5-4ead-8ac0-5a7f638d9454 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:28:51.721284 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96413a-00ef-4305-897c-32a19bebaf8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:28:51.722277 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96413a-00ef-4305-897c-32a19bebaf8b service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:28:51.722277 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96413a-00ef-4305-897c-32a19bebaf8b service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:28:51.723134 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96413a-00ef-4305-897c-32a19bebaf8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:28:51.733977 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96413a-00ef-4305-897c-32a19bebaf8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:28:51.735431 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96413a-00ef-4305-897c-32a19bebaf8b service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:28:51.745717 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 469/932] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:28:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:28:54.262602 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f061cb-37b4-43d2-a4f4-b023383a0a32 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:28:54.263156 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f061cb-37b4-43d2-a4f4-b023383a0a32 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:28:54.263263 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f061cb-37b4-43d2-a4f4-b023383a0a32 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:28:54.264717 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 464/933] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:28:54.270038 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fbc00-469c-44e5-9399-cb8049d33c44 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:28:54.270476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fbc00-469c-44e5-9399-cb8049d33c44 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:28:54.270649 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fbc00-469c-44e5-9399-cb8049d33c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:28:54.289269 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-cd5fbc00-469c-44e5-9399-cb8049d33c44 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:28:54.290808 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-cd5fbc00-469c-44e5-9399-cb8049d33c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:28:54.299457 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 470/934] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:28:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:28:54.341210 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f061cb-37b4-43d2-a4f4-b023383a0a32 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:28:54.352184 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f061cb-37b4-43d2-a4f4-b023383a0a32 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:28:54.355852 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d549c7-efe6-4c88-87a2-2f349ae701a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:28:54.356572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d549c7-efe6-4c88-87a2-2f349ae701a0 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:28:54.356942 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d549c7-efe6-4c88-87a2-2f349ae701a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:28:54.357286 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d549c7-efe6-4c88-87a2-2f349ae701a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:28:54.366820 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d549c7-efe6-4c88-87a2-2f349ae701a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:28:54.368900 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d549c7-efe6-4c88-87a2-2f349ae701a0 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:28:54.378768 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 465/935] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:28:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:28:56.952071 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d2afd-5835-403c-8a99-bc110974062b None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:28:56.952590 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d2afd-5835-403c-8a99-bc110974062b None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:28:56.952681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d2afd-5835-403c-8a99-bc110974062b None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:28:56.953971 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 471/936] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:28:56.959208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace6822-9399-4219-a3e7-549b6d8accd8 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:28:56.959608 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace6822-9399-4219-a3e7-549b6d8accd8 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:28:56.959916 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace6822-9399-4219-a3e7-549b6d8accd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:28:56.996499 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-2ace6822-9399-4219-a3e7-549b6d8accd8 None None] MFA Rules not processed for user `616e5238fb534043a0db27a9e7971c92`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:28:56.997682 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-2ace6822-9399-4219-a3e7-549b6d8accd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:28:57.037032 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:28:57.065406 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 466/937] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:28:56 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:28:57.107066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d2afd-5835-403c-8a99-bc110974062b None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:28:57.117986 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d2afd-5835-403c-8a99-bc110974062b None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:28:57.121433 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb120e-7058-454a-a6b9-712a2fd9ce1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:28:57.122076 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb120e-7058-454a-a6b9-712a2fd9ce1c service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:28:57.122359 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb120e-7058-454a-a6b9-712a2fd9ce1c service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:28:57.122636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb120e-7058-454a-a6b9-712a2fd9ce1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:28:57.131813 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb120e-7058-454a-a6b9-712a2fd9ce1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:28:57.133325 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb120e-7058-454a-a6b9-712a2fd9ce1c service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:28:57.142839 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 472/938] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:28:57 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:28:59.954254 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c805-5ba6-494e-9842-20295b4c75a1 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:28:59.954791 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c805-5ba6-494e-9842-20295b4c75a1 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:28:59.954791 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c805-5ba6-494e-9842-20295b4c75a1 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:28:59.956220 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 467/939] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:28:59.961380 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef17a2-0759-4fba-80e1-2ec9d9ef445a None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:28:59.961902 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef17a2-0759-4fba-80e1-2ec9d9ef445a None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:28:59.962013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef17a2-0759-4fba-80e1-2ec9d9ef445a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:28:59.979700 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-0cef17a2-0759-4fba-80e1-2ec9d9ef445a None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:28:59.980890 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-0cef17a2-0759-4fba-80e1-2ec9d9ef445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:00.052054 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 473/940] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:28:59 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:00.110276 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e77f60-b81e-49ab-b3cb-15ca4dcccb62 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:00.110564 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e77f60-b81e-49ab-b3cb-15ca4dcccb62 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:00.110842 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e77f60-b81e-49ab-b3cb-15ca4dcccb62 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:00.112306 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 468/941] 10.222.0.86 () {54 vars in 964 bytes} [Fri Jul 15 16:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:00.118276 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89050460-7710-4fd8-bc82-74bae5d2d2b8 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:00.118512 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89050460-7710-4fd8-bc82-74bae5d2d2b8 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:00.118799 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89050460-7710-4fd8-bc82-74bae5d2d2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:00.137354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-89050460-7710-4fd8-bc82-74bae5d2d2b8 None None] MFA Rules not processed for user `8e620f2a895241279b63327d6a7d3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:00.138568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-89050460-7710-4fd8-bc82-74bae5d2d2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:00.145043 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 474/942] 10.222.0.86 () {58 vars in 1061 bytes} [Fri Jul 15 16:29:00 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 16:29:00.154079 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e77f60-b81e-49ab-b3cb-15ca4dcccb62 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:00.164300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e77f60-b81e-49ab-b3cb-15ca4dcccb62 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:00.168375 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5a3a5-e032-4121-9352-3203faa28e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:00.168996 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5a3a5-e032-4121-9352-3203faa28e92 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:00.169280 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5a3a5-e032-4121-9352-3203faa28e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:00.169555 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5a3a5-e032-4121-9352-3203faa28e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:00.178134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5a3a5-e032-4121-9352-3203faa28e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:00.179584 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5a3a5-e032-4121-9352-3203faa28e92 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:00.188627 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 469/943] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:00 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 16:29:03.509633 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20bef6-5dd1-4965-b49a-ee05ddacf137 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:03.510368 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20bef6-5dd1-4965-b49a-ee05ddacf137 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:03.510368 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20bef6-5dd1-4965-b49a-ee05ddacf137 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:03.511870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 475/944] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:03.517328 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33cd34-d22e-4d88-97dc-f8e40d56dc21 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:03.517779 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33cd34-d22e-4d88-97dc-f8e40d56dc21 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:03.518000 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33cd34-d22e-4d88-97dc-f8e40d56dc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:03.535416 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-9f33cd34-d22e-4d88-97dc-f8e40d56dc21 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:03.536622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-9f33cd34-d22e-4d88-97dc-f8e40d56dc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:03.544902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 470/945] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:03.581223 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20bef6-5dd1-4965-b49a-ee05ddacf137 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:03.591718 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20bef6-5dd1-4965-b49a-ee05ddacf137 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:03.595191 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79165655-0c74-4a14-8fa3-bde6707513c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:03.595821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165655-0c74-4a14-8fa3-bde6707513c9 service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:03.596108 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165655-0c74-4a14-8fa3-bde6707513c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:03.596388 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165655-0c74-4a14-8fa3-bde6707513c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:03.605613 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79165655-0c74-4a14-8fa3-bde6707513c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:03.607082 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79165655-0c74-4a14-8fa3-bde6707513c9 service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:03.616418 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 476/946] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:05.942316 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a33655-2267-4567-a5f6-cf8e35dd515a None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:05.942892 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a33655-2267-4567-a5f6-cf8e35dd515a None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:05.942892 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a33655-2267-4567-a5f6-cf8e35dd515a None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:05.944433 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 471/947] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:05.949795 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c837f26-dc33-47b9-924f-ff165e83eac2 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:05.950185 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c837f26-dc33-47b9-924f-ff165e83eac2 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:05.950491 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c837f26-dc33-47b9-924f-ff165e83eac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:05.968187 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-3c837f26-dc33-47b9-924f-ff165e83eac2 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:05.969376 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-3c837f26-dc33-47b9-924f-ff165e83eac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:05.977578 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 477/948] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:06.014359 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a33655-2267-4567-a5f6-cf8e35dd515a None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:06.024964 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a33655-2267-4567-a5f6-cf8e35dd515a None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:06.028434 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853fdf8-5894-40f9-877a-401b3df7896e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:06.029077 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853fdf8-5894-40f9-877a-401b3df7896e service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:06.029361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853fdf8-5894-40f9-877a-401b3df7896e service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:06.029637 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853fdf8-5894-40f9-877a-401b3df7896e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:06.038696 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853fdf8-5894-40f9-877a-401b3df7896e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:06.040655 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853fdf8-5894-40f9-877a-401b3df7896e service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:06.050146 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 472/949] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:08.333755 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc12b1-ba8a-46e6-b2c5-2b272dc9636e None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:08.334355 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc12b1-ba8a-46e6-b2c5-2b272dc9636e None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:08.334355 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc12b1-ba8a-46e6-b2c5-2b272dc9636e None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:08.336011 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 478/950] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:08.341127 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546ef60-d417-44a7-a95e-2f2157356b26 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:08.341581 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546ef60-d417-44a7-a95e-2f2157356b26 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:08.341804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546ef60-d417-44a7-a95e-2f2157356b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:08.359132 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-1546ef60-d417-44a7-a95e-2f2157356b26 None None] MFA Rules not processed for user `616e5238fb534043a0db27a9e7971c92`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:08.360318 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-1546ef60-d417-44a7-a95e-2f2157356b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:08.368626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 473/951] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:08 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:08.407365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc12b1-ba8a-46e6-b2c5-2b272dc9636e None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:08.417976 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc12b1-ba8a-46e6-b2c5-2b272dc9636e None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:08.421410 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5c394-8e53-4709-9999-e4576c83ac1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:08.422045 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5c394-8e53-4709-9999-e4576c83ac1f service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:08.422330 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5c394-8e53-4709-9999-e4576c83ac1f service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:08.422607 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5c394-8e53-4709-9999-e4576c83ac1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:08.432117 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5c394-8e53-4709-9999-e4576c83ac1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:08.433634 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5c394-8e53-4709-9999-e4576c83ac1f service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:08.443166 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 479/952] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:08 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:10.901282 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546fed4-e2e0-4683-ac06-7ed6d11e6d7b None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:10.901812 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546fed4-e2e0-4683-ac06-7ed6d11e6d7b None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:10.901916 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546fed4-e2e0-4683-ac06-7ed6d11e6d7b None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:10.903423 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 474/953] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:10.910138 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b04909-b18f-4b4f-a34f-af0e9d6a39b1 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:10.910688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b04909-b18f-4b4f-a34f-af0e9d6a39b1 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:10.910688 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b04909-b18f-4b4f-a34f-af0e9d6a39b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:10.929406 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-13b04909-b18f-4b4f-a34f-af0e9d6a39b1 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:10.931040 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-13b04909-b18f-4b4f-a34f-af0e9d6a39b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:10.938331 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 480/954] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:10.976291 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546fed4-e2e0-4683-ac06-7ed6d11e6d7b None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:10.986904 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546fed4-e2e0-4683-ac06-7ed6d11e6d7b None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:10.990389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79aff0e-5757-4896-9150-42afc8e380e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:10.991129 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aff0e-5757-4896-9150-42afc8e380e8 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:10.991568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aff0e-5757-4896-9150-42afc8e380e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:10.991916 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aff0e-5757-4896-9150-42afc8e380e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:11.001023 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79aff0e-5757-4896-9150-42afc8e380e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:11.002449 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79aff0e-5757-4896-9150-42afc8e380e8 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:11.012474 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 475/955] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:13.275055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1e20d-7dec-4462-b255-2a3cc0ee953f None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:13.275055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1e20d-7dec-4462-b255-2a3cc0ee953f None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:13.275055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1e20d-7dec-4462-b255-2a3cc0ee953f None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:13.275713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 481/956] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:13.280438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5cd63-ea50-46f8-ac2d-c99dc1367b6b None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:13.280844 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5cd63-ea50-46f8-ac2d-c99dc1367b6b None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:13.281177 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5cd63-ea50-46f8-ac2d-c99dc1367b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:13.298989 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-d0e5cd63-ea50-46f8-ac2d-c99dc1367b6b None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:13.300173 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-d0e5cd63-ea50-46f8-ac2d-c99dc1367b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:13.308676 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 476/957] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 16:29:13.348485 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1e20d-7dec-4462-b255-2a3cc0ee953f None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:13.354405 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=68 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:29:13.360466 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1e20d-7dec-4462-b255-2a3cc0ee953f None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:13.363881 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263abbe-8a33-4768-b707-d68fe3854d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:13.364511 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263abbe-8a33-4768-b707-d68fe3854d05 service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:13.364797 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263abbe-8a33-4768-b707-d68fe3854d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:13.365072 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263abbe-8a33-4768-b707-d68fe3854d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:13.374550 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263abbe-8a33-4768-b707-d68fe3854d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:13.376013 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263abbe-8a33-4768-b707-d68fe3854d05 service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:13.385363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 482/958] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:16.000217 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b95ac-74e7-4aa1-b153-f9d3c852847a None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:16.000767 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b95ac-74e7-4aa1-b153-f9d3c852847a None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:16.000767 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b95ac-74e7-4aa1-b153-f9d3c852847a None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:16.002155 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 477/959] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:16.007715 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044103d-4fae-4827-a389-3c1d490801e3 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:16.008131 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044103d-4fae-4827-a389-3c1d490801e3 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:16.008287 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044103d-4fae-4827-a389-3c1d490801e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:16.026190 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-9044103d-4fae-4827-a389-3c1d490801e3 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:16.027425 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-9044103d-4fae-4827-a389-3c1d490801e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:16.035173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 483/960] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:16 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:16.073407 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b95ac-74e7-4aa1-b153-f9d3c852847a None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:16.083983 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b95ac-74e7-4aa1-b153-f9d3c852847a None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:16.087542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc6e07-b5c3-474e-aeab-01d7e0987723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:16.088170 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc6e07-b5c3-474e-aeab-01d7e0987723 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:16.088458 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc6e07-b5c3-474e-aeab-01d7e0987723 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:16.088738 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc6e07-b5c3-474e-aeab-01d7e0987723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:16.097510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc6e07-b5c3-474e-aeab-01d7e0987723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:16.098958 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc6e07-b5c3-474e-aeab-01d7e0987723 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:16.108180 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 478/961] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:16 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:20.243842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ffc4d-81fa-4264-a927-2299aff9cc4b None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:20.244331 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ffc4d-81fa-4264-a927-2299aff9cc4b None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:20.244331 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ffc4d-81fa-4264-a927-2299aff9cc4b None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:20.245664 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 484/962] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:20.250751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7df42-f49e-442d-947b-4f8b8c31453a None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:20.251207 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7df42-f49e-442d-947b-4f8b8c31453a None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:20.251476 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7df42-f49e-442d-947b-4f8b8c31453a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:20.269362 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-fec7df42-f49e-442d-947b-4f8b8c31453a None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:20.270543 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-fec7df42-f49e-442d-947b-4f8b8c31453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:20.278381 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 479/963] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:20.318742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ffc4d-81fa-4264-a927-2299aff9cc4b None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:20.329469 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ffc4d-81fa-4264-a927-2299aff9cc4b None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:20.332910 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070a0e5-a098-4fdb-bb58-ddcf4e55b274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:20.333540 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a0e5-a098-4fdb-bb58-ddcf4e55b274 service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:20.333825 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a0e5-a098-4fdb-bb58-ddcf4e55b274 service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:20.334102 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a0e5-a098-4fdb-bb58-ddcf4e55b274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:20.343371 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070a0e5-a098-4fdb-bb58-ddcf4e55b274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:20.344796 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070a0e5-a098-4fdb-bb58-ddcf4e55b274 service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:20.354676 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 485/964] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:23.134363 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bd47d-20b5-417c-8ba9-000f4fe723bd None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:23.134821 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bd47d-20b5-417c-8ba9-000f4fe723bd None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:23.135024 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bd47d-20b5-417c-8ba9-000f4fe723bd None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:23.136305 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 480/965] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:23.141963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597f0ab-e1d2-44c3-bf9a-8ad214e9ed61 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:23.142390 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597f0ab-e1d2-44c3-bf9a-8ad214e9ed61 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:23.142522 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597f0ab-e1d2-44c3-bf9a-8ad214e9ed61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:23.160710 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-1597f0ab-e1d2-44c3-bf9a-8ad214e9ed61 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:23.161914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-1597f0ab-e1d2-44c3-bf9a-8ad214e9ed61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:23.170406 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 486/966] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:23 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:23.208975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bd47d-20b5-417c-8ba9-000f4fe723bd None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:23.219899 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bd47d-20b5-417c-8ba9-000f4fe723bd None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:23.223422 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72956c24-add1-4c6d-a3f8-4678ce111bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:23.224060 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72956c24-add1-4c6d-a3f8-4678ce111bbc service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:23.224351 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72956c24-add1-4c6d-a3f8-4678ce111bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:23.224633 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72956c24-add1-4c6d-a3f8-4678ce111bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:23.234178 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72956c24-add1-4c6d-a3f8-4678ce111bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:23.235649 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72956c24-add1-4c6d-a3f8-4678ce111bbc service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:23.245828 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 481/967] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:23 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:27.444307 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c180f-e929-43d7-854d-96c0ed0c6936 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:27.444816 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c180f-e929-43d7-854d-96c0ed0c6936 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:27.444907 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c180f-e929-43d7-854d-96c0ed0c6936 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:27.446761 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 487/968] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:27.452066 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601f25e-912d-403d-9212-29273a11a11c None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:27.452459 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601f25e-912d-403d-9212-29273a11a11c None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:27.452619 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601f25e-912d-403d-9212-29273a11a11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:27.458559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=54 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:29:27.471465 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-2601f25e-912d-403d-9212-29273a11a11c None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:27.472659 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-2601f25e-912d-403d-9212-29273a11a11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:27.480492 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 482/969] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:27.518908 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c180f-e929-43d7-854d-96c0ed0c6936 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:27.530092 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c180f-e929-43d7-854d-96c0ed0c6936 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:27.533618 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b63d8-a57a-44b8-9113-db21a2485ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:27.534250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b63d8-a57a-44b8-9113-db21a2485ffd service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:27.534538 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b63d8-a57a-44b8-9113-db21a2485ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:27.534819 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b63d8-a57a-44b8-9113-db21a2485ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:27.544071 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b63d8-a57a-44b8-9113-db21a2485ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:27.545625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b63d8-a57a-44b8-9113-db21a2485ffd service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:27.555320 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 488/970] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:33.105082 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae1b14-68a7-4d02-b0c4-d7439181f810 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:33.106563 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae1b14-68a7-4d02-b0c4-d7439181f810 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:33.107371 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae1b14-68a7-4d02-b0c4-d7439181f810 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:33.111595 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 483/971] 10.222.0.86 () {54 vars in 921 bytes} [Fri Jul 15 16:29:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:33.115839 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eee6d-8606-4ca2-b279-66fedc433705 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:33.116646 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eee6d-8606-4ca2-b279-66fedc433705 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:33.117059 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eee6d-8606-4ca2-b279-66fedc433705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:33.211023 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-9f0eee6d-8606-4ca2-b279-66fedc433705 None None] MFA Rules not processed for user `f716b4b39b3d4547ab937f5a5ffccf08`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:33.213144 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-9f0eee6d-8606-4ca2-b279-66fedc433705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:33.352838 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 489/972] 10.222.0.86 () {58 vars in 1018 bytes} [Fri Jul 15 16:29:33 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 16:29:37.466416 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=2 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:29:37.763633 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6761f-e7f0-461b-be74-9105ca929c13 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:37.764046 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6761f-e7f0-461b-be74-9105ca929c13 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:37.764542 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6761f-e7f0-461b-be74-9105ca929c13 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:37.766127 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 484/973] 10.222.0.86 () {54 vars in 921 bytes} [Fri Jul 15 16:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:37.771414 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be775b-d129-4d08-b66c-7528fc3bc760 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:37.771893 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be775b-d129-4d08-b66c-7528fc3bc760 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:37.772021 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be775b-d129-4d08-b66c-7528fc3bc760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:37.792885 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-87be775b-d129-4d08-b66c-7528fc3bc760 None None] MFA Rules not processed for user `f716b4b39b3d4547ab937f5a5ffccf08`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:37.794482 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-87be775b-d129-4d08-b66c-7528fc3bc760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:37.803700 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 490/974] 10.222.0.86 () {58 vars in 1018 bytes} [Fri Jul 15 16:29:37 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:39.276295 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065d4f3-5951-4887-9f0b-7e06c442f32f None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:39.276804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065d4f3-5951-4887-9f0b-7e06c442f32f None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:39.276884 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065d4f3-5951-4887-9f0b-7e06c442f32f None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:39.278204 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 485/975] 10.222.0.86 () {54 vars in 921 bytes} [Fri Jul 15 16:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:39.283463 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52d7b2-5514-4abd-9daf-d4f39e407b67 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:39.283905 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52d7b2-5514-4abd-9daf-d4f39e407b67 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:39.284058 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52d7b2-5514-4abd-9daf-d4f39e407b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:39.302341 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-ce52d7b2-5514-4abd-9daf-d4f39e407b67 None None] MFA Rules not processed for user `f716b4b39b3d4547ab937f5a5ffccf08`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:39.303569 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-ce52d7b2-5514-4abd-9daf-d4f39e407b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:39.312546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 491/976] 10.222.0.86 () {58 vars in 1018 bytes} [Fri Jul 15 16:29:39 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:43.125802 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967ffe1-5b73-4499-9bd8-ab0276abd9ee None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:43.126352 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967ffe1-5b73-4499-9bd8-ab0276abd9ee None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:43.126569 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967ffe1-5b73-4499-9bd8-ab0276abd9ee None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:43.128090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 486/977] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:43.133246 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e677f-ab9f-46fd-9194-dd6a4b7d412c None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:43.133630 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e677f-ab9f-46fd-9194-dd6a4b7d412c None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:43.133805 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e677f-ab9f-46fd-9194-dd6a4b7d412c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:43.158965 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-934e677f-ab9f-46fd-9194-dd6a4b7d412c None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:43.160091 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-934e677f-ab9f-46fd-9194-dd6a4b7d412c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:43.168550 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 492/978] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:43.224517 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd20795-9673-4b14-8d10-afbac6b419b7 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:43.224807 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd20795-9673-4b14-8d10-afbac6b419b7 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:43.225251 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd20795-9673-4b14-8d10-afbac6b419b7 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:43.227318 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 487/979] 10.222.0.86 () {54 vars in 961 bytes} [Fri Jul 15 16:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:43.237190 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1e06b-20f9-4056-b7d6-3eace0da6e7d None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:43.237672 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1e06b-20f9-4056-b7d6-3eace0da6e7d None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:43.238224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1e06b-20f9-4056-b7d6-3eace0da6e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:43.284287 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-a3c1e06b-20f9-4056-b7d6-3eace0da6e7d None None] MFA Rules not processed for user `f34916bd4d56411e8994d1c476885e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:43.285783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-a3c1e06b-20f9-4056-b7d6-3eace0da6e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:43.335824 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:29:43.365311 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 493/980] 10.222.0.86 () {58 vars in 1058 bytes} [Fri Jul 15 16:29:43 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 16:29:43.373629 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd20795-9673-4b14-8d10-afbac6b419b7 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:43.388244 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd20795-9673-4b14-8d10-afbac6b419b7 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:43.393317 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7c45c-edf1-45e4-9dec-21b01dc5b4f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:43.394072 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7c45c-edf1-45e4-9dec-21b01dc5b4f5 service nova] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:43.394471 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7c45c-edf1-45e4-9dec-21b01dc5b4f5 service nova] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:43.394884 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7c45c-edf1-45e4-9dec-21b01dc5b4f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:43.403361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7c45c-edf1-45e4-9dec-21b01dc5b4f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:43.405112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7c45c-edf1-45e4-9dec-21b01dc5b4f5 service nova] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:43.415970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 488/981] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:45.916079 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fc984-c365-47b2-8283-53dd9e6e9d65 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:45.916637 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fc984-c365-47b2-8283-53dd9e6e9d65 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:45.916637 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fc984-c365-47b2-8283-53dd9e6e9d65 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:45.920387 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 494/982] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:45.923482 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed237-2843-4d97-b75b-d05e9c8cded9 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:45.924290 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed237-2843-4d97-b75b-d05e9c8cded9 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:45.924749 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed237-2843-4d97-b75b-d05e9c8cded9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:45.944741 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-0ffed237-2843-4d97-b75b-d05e9c8cded9 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:45.946198 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-0ffed237-2843-4d97-b75b-d05e9c8cded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:45.957090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 489/983] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:46.004894 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fc984-c365-47b2-8283-53dd9e6e9d65 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:46.019647 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fc984-c365-47b2-8283-53dd9e6e9d65 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:46.025124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713216f-907c-4098-93e2-00853e01148a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:46.025764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713216f-907c-4098-93e2-00853e01148a service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:46.026056 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713216f-907c-4098-93e2-00853e01148a service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:46.026338 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713216f-907c-4098-93e2-00853e01148a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:46.038020 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713216f-907c-4098-93e2-00853e01148a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:46.041668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713216f-907c-4098-93e2-00853e01148a service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:46.069957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 495/984] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:48.652105 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f1f0e-2b3b-4e0a-bd7f-fce80764dc65 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:48.652657 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f1f0e-2b3b-4e0a-bd7f-fce80764dc65 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:48.652657 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f1f0e-2b3b-4e0a-bd7f-fce80764dc65 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:48.654077 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 490/985] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:48.659756 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001a01a-5866-4432-af93-b43aa5c49d86 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:48.660113 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001a01a-5866-4432-af93-b43aa5c49d86 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:48.660216 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001a01a-5866-4432-af93-b43aa5c49d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:48.688125 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-e001a01a-5866-4432-af93-b43aa5c49d86 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:48.689348 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-e001a01a-5866-4432-af93-b43aa5c49d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:48.701389 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 496/986] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:48.748610 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8521b-d888-401b-9cd7-3be18cac508d None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:48.748908 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8521b-d888-401b-9cd7-3be18cac508d None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:48.749198 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8521b-d888-401b-9cd7-3be18cac508d None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:48.750565 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 491/987] 10.222.0.86 () {54 vars in 961 bytes} [Fri Jul 15 16:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:48.755942 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa281997-e778-4d21-9d4b-691e8c50d0c3 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:48.756233 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa281997-e778-4d21-9d4b-691e8c50d0c3 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:48.756509 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa281997-e778-4d21-9d4b-691e8c50d0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:48.774604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-fa281997-e778-4d21-9d4b-691e8c50d0c3 None None] MFA Rules not processed for user `f34916bd4d56411e8994d1c476885e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:48.775824 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-fa281997-e778-4d21-9d4b-691e8c50d0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:48.785241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 497/988] 10.222.0.86 () {58 vars in 1058 bytes} [Fri Jul 15 16:29:48 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:48.793286 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8521b-d888-401b-9cd7-3be18cac508d None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:48.806891 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8521b-d888-401b-9cd7-3be18cac508d None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:48.811926 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65d9ef-e0ec-457e-a17d-b9ea9073990e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:48.812562 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65d9ef-e0ec-457e-a17d-b9ea9073990e service nova] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:48.812851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65d9ef-e0ec-457e-a17d-b9ea9073990e service nova] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:48.813131 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65d9ef-e0ec-457e-a17d-b9ea9073990e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:48.824040 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65d9ef-e0ec-457e-a17d-b9ea9073990e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:48.825631 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65d9ef-e0ec-457e-a17d-b9ea9073990e service nova] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:48.835121 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 492/989] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:51.194177 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c6af8-bc7a-4b04-9e04-0cca3b9fa4ad None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:51.195828 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c6af8-bc7a-4b04-9e04-0cca3b9fa4ad None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:51.196264 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c6af8-bc7a-4b04-9e04-0cca3b9fa4ad None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:51.202026 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 498/990] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:51.203371 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6dba5-8609-4fbe-b284-6e5d3d694e11 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:51.204161 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6dba5-8609-4fbe-b284-6e5d3d694e11 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:51.204618 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6dba5-8609-4fbe-b284-6e5d3d694e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:51.223593 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-13b6dba5-8609-4fbe-b284-6e5d3d694e11 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:51.225119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-13b6dba5-8609-4fbe-b284-6e5d3d694e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:51.234357 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 493/991] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 16:29:51.284407 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c6af8-bc7a-4b04-9e04-0cca3b9fa4ad None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:51.299852 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c6af8-bc7a-4b04-9e04-0cca3b9fa4ad None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:51.306570 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861ef6b-3080-4217-a164-7f65507512f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:51.307451 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ef6b-3080-4217-a164-7f65507512f6 service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:51.307890 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ef6b-3080-4217-a164-7f65507512f6 service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:51.308321 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ef6b-3080-4217-a164-7f65507512f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:51.317504 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861ef6b-3080-4217-a164-7f65507512f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:51.319478 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861ef6b-3080-4217-a164-7f65507512f6 service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:51.331689 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 499/992] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:53.091527 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923d122-83e8-419a-b1c5-a6efa1a5ef6b None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:53.093497 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923d122-83e8-419a-b1c5-a6efa1a5ef6b None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:53.094932 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923d122-83e8-419a-b1c5-a6efa1a5ef6b None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:53.104696 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 494/993] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:53.106325 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3db86-7682-473c-bd4c-a9dadfffacf1 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:53.106745 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3db86-7682-473c-bd4c-a9dadfffacf1 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:53.107125 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3db86-7682-473c-bd4c-a9dadfffacf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:53.141591 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-fca3db86-7682-473c-bd4c-a9dadfffacf1 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:53.143786 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-fca3db86-7682-473c-bd4c-a9dadfffacf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:53.167447 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 500/994] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:53.487125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1f87c-a57d-44b8-b73d-60d853577231 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:53.487553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1f87c-a57d-44b8-b73d-60d853577231 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:53.487915 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1f87c-a57d-44b8-b73d-60d853577231 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:53.489388 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 495/995] 10.222.0.86 () {54 vars in 963 bytes} [Fri Jul 15 16:29:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:53.494657 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d759c-b99b-4509-9cec-36efa538402c None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:53.495060 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d759c-b99b-4509-9cec-36efa538402c None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:53.495434 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d759c-b99b-4509-9cec-36efa538402c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:53.534641 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-b51d759c-b99b-4509-9cec-36efa538402c None None] MFA Rules not processed for user `a101281ae1f2474886c1ec214f042d24`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:53.536026 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-b51d759c-b99b-4509-9cec-36efa538402c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:53.597058 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 501/996] 10.222.0.86 () {58 vars in 1060 bytes} [Fri Jul 15 16:29:53 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 16:29:53.604419 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1f87c-a57d-44b8-b73d-60d853577231 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:53.615196 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1f87c-a57d-44b8-b73d-60d853577231 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:53.618961 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70786c83-9e78-40fc-8734-246038345262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a101281ae1f2474886c1ec214f042d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:53.619617 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70786c83-9e78-40fc-8734-246038345262 service cinder] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:53.619909 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70786c83-9e78-40fc-8734-246038345262 service cinder] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:53.620194 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70786c83-9e78-40fc-8734-246038345262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:53.630437 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70786c83-9e78-40fc-8734-246038345262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:53.631947 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70786c83-9e78-40fc-8734-246038345262 service cinder] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:53.643804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 496/997] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:53.795677 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89cc9-0a6a-4eca-9efe-c825f85cf291 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:53.796090 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89cc9-0a6a-4eca-9efe-c825f85cf291 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:53.796477 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89cc9-0a6a-4eca-9efe-c825f85cf291 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:53.798006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 502/998] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:53.803495 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863942eb-a3b1-4567-8fb8-d0536986f04e None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:53.803794 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863942eb-a3b1-4567-8fb8-d0536986f04e None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:53.804083 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863942eb-a3b1-4567-8fb8-d0536986f04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:53.823451 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-863942eb-a3b1-4567-8fb8-d0536986f04e None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:53.824700 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-863942eb-a3b1-4567-8fb8-d0536986f04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:53.832769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 497/999] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:53.878759 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b89cc9-0a6a-4eca-9efe-c825f85cf291 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:53.893498 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b89cc9-0a6a-4eca-9efe-c825f85cf291 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:53.898715 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdb805-4f3d-433c-8572-f69a2da58a93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:53.899485 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdb805-4f3d-433c-8572-f69a2da58a93 service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:53.899868 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdb805-4f3d-433c-8572-f69a2da58a93 service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:53.900245 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdb805-4f3d-433c-8572-f69a2da58a93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:53.909110 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdb805-4f3d-433c-8572-f69a2da58a93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:53.910780 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdb805-4f3d-433c-8572-f69a2da58a93 service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:53.920713 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 503/1000] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:56.225077 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83efbc8-e494-4f5c-aac7-bf06a9ad94b6 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:56.225510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83efbc8-e494-4f5c-aac7-bf06a9ad94b6 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:56.225646 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83efbc8-e494-4f5c-aac7-bf06a9ad94b6 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:56.227138 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 498/1001] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:56.232807 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b35822-7ba8-428d-968c-1c12c0773164 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:56.233250 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b35822-7ba8-428d-968c-1c12c0773164 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:56.233365 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b35822-7ba8-428d-968c-1c12c0773164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:56.253000 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-52b35822-7ba8-428d-968c-1c12c0773164 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:56.254212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-52b35822-7ba8-428d-968c-1c12c0773164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:56.262896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 504/1002] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:56.308316 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83efbc8-e494-4f5c-aac7-bf06a9ad94b6 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:56.330504 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83efbc8-e494-4f5c-aac7-bf06a9ad94b6 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:56.337140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf9f94-31af-4c54-abbd-41eb59eb5bd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:56.337888 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf9f94-31af-4c54-abbd-41eb59eb5bd8 service nova] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:56.338176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf9f94-31af-4c54-abbd-41eb59eb5bd8 service nova] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:56.341634 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf9f94-31af-4c54-abbd-41eb59eb5bd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:56.352212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf9f94-31af-4c54-abbd-41eb59eb5bd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:56.353810 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf9f94-31af-4c54-abbd-41eb59eb5bd8 service nova] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:56.365103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 499/1003] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:29:58.652670 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69696f1-b84b-489f-8d29-6f60650b44d5 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:58.653227 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69696f1-b84b-489f-8d29-6f60650b44d5 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:58.653227 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69696f1-b84b-489f-8d29-6f60650b44d5 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:58.654584 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 505/1004] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:29:58.659845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2ecd0-7244-4c18-804a-189d55d387fb None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:58.660229 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2ecd0-7244-4c18-804a-189d55d387fb None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:58.660399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2ecd0-7244-4c18-804a-189d55d387fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:58.679967 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-6df2ecd0-7244-4c18-804a-189d55d387fb None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:29:58.681167 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-6df2ecd0-7244-4c18-804a-189d55d387fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:29:58.689192 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 500/1005] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:29:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:29:58.732107 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69696f1-b84b-489f-8d29-6f60650b44d5 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:29:58.748297 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69696f1-b84b-489f-8d29-6f60650b44d5 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:29:58.753643 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcde8e-72cd-4011-b201-9643de5040a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:29:58.754446 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcde8e-72cd-4011-b201-9643de5040a8 service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:29:58.754844 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcde8e-72cd-4011-b201-9643de5040a8 service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:29:58.755267 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcde8e-72cd-4011-b201-9643de5040a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:29:58.764429 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcde8e-72cd-4011-b201-9643de5040a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:29:58.766060 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcde8e-72cd-4011-b201-9643de5040a8 service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:29:58.794919 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 506/1006] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:29:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:01.038347 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca60df-0ac1-44c0-871f-9d01210ad9a5 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:01.039425 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca60df-0ac1-44c0-871f-9d01210ad9a5 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:01.039504 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca60df-0ac1-44c0-871f-9d01210ad9a5 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:01.040831 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 501/1007] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:01.046073 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026811d-9b35-4181-b699-93455db815ea None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:01.046476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026811d-9b35-4181-b699-93455db815ea None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:01.046650 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026811d-9b35-4181-b699-93455db815ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:01.065103 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-4026811d-9b35-4181-b699-93455db815ea None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:01.066618 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-4026811d-9b35-4181-b699-93455db815ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:01.075996 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 507/1008] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:30:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:01.124909 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca60df-0ac1-44c0-871f-9d01210ad9a5 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:01.139822 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca60df-0ac1-44c0-871f-9d01210ad9a5 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:01.145835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10cf2f-3edd-4bdf-bb27-cb8fd92350e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:01.146510 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10cf2f-3edd-4bdf-bb27-cb8fd92350e4 service nova] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:01.146801 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10cf2f-3edd-4bdf-bb27-cb8fd92350e4 service nova] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:01.147141 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10cf2f-3edd-4bdf-bb27-cb8fd92350e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:01.157196 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10cf2f-3edd-4bdf-bb27-cb8fd92350e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:01.158804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10cf2f-3edd-4bdf-bb27-cb8fd92350e4 service nova] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:01.169055 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 502/1009] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:03.422934 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782ce23-dfd0-4804-9fcb-845b7e7711d9 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:03.423925 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782ce23-dfd0-4804-9fcb-845b7e7711d9 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:03.424395 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782ce23-dfd0-4804-9fcb-845b7e7711d9 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:03.426247 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 508/1010] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:30:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:30:03.432574 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7062c36-1780-46a8-908f-cec0ccd4c1a5 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:03.433212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7062c36-1780-46a8-908f-cec0ccd4c1a5 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:03.433212 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7062c36-1780-46a8-908f-cec0ccd4c1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:03.451541 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-f7062c36-1780-46a8-908f-cec0ccd4c1a5 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:03.452744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-f7062c36-1780-46a8-908f-cec0ccd4c1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:03.461036 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 503/1011] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:30:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:03.509752 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782ce23-dfd0-4804-9fcb-845b7e7711d9 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:03.525786 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782ce23-dfd0-4804-9fcb-845b7e7711d9 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:03.531234 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1d468-aa33-42ac-9171-cf1d467d8c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:03.531883 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d468-aa33-42ac-9171-cf1d467d8c5a service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:03.532162 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d468-aa33-42ac-9171-cf1d467d8c5a service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:03.532440 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d468-aa33-42ac-9171-cf1d467d8c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:03.541094 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1d468-aa33-42ac-9171-cf1d467d8c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:03.542678 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1d468-aa33-42ac-9171-cf1d467d8c5a service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:03.551973 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 509/1012] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 16:30:06.126155 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ae3c9-a72b-4c00-9945-27e65320f467 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:06.127358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ae3c9-a72b-4c00-9945-27e65320f467 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:06.127358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ae3c9-a72b-4c00-9945-27e65320f467 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:06.128105 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 504/1013] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:06.133639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115177e-6c24-4bd7-a56f-7ecc1fcc69de None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:06.134157 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115177e-6c24-4bd7-a56f-7ecc1fcc69de None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:06.134264 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115177e-6c24-4bd7-a56f-7ecc1fcc69de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:06.153263 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-b115177e-6c24-4bd7-a56f-7ecc1fcc69de None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:06.154472 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-b115177e-6c24-4bd7-a56f-7ecc1fcc69de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:06.162604 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 510/1014] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:30:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:06.209480 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ae3c9-a72b-4c00-9945-27e65320f467 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:06.228410 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ae3c9-a72b-4c00-9945-27e65320f467 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:06.233674 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094acafb-02b4-4837-9ea5-065f424556f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:06.234310 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094acafb-02b4-4837-9ea5-065f424556f3 service nova] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:06.234589 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094acafb-02b4-4837-9ea5-065f424556f3 service nova] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:06.234887 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094acafb-02b4-4837-9ea5-065f424556f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:06.244216 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094acafb-02b4-4837-9ea5-065f424556f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:06.245800 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094acafb-02b4-4837-9ea5-065f424556f3 service nova] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:06.255281 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 505/1015] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:09.133763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86f25c-77f7-46b8-bc37-2e333378b6c8 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:09.134353 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86f25c-77f7-46b8-bc37-2e333378b6c8 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:09.134353 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86f25c-77f7-46b8-bc37-2e333378b6c8 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:09.135859 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 511/1016] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:09.140881 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02043a6-906d-46d1-986b-4a771f214efc None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:09.141326 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02043a6-906d-46d1-986b-4a771f214efc None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:09.141434 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02043a6-906d-46d1-986b-4a771f214efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:09.156845 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=52 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:30:09.170949 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-f02043a6-906d-46d1-986b-4a771f214efc None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:09.172144 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-f02043a6-906d-46d1-986b-4a771f214efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:09.180449 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 506/1017] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:30:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:09.227162 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86f25c-77f7-46b8-bc37-2e333378b6c8 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:09.240515 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86f25c-77f7-46b8-bc37-2e333378b6c8 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:09.246096 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91b377-110e-4bf6-9556-dbcc1598e7a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:09.246731 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91b377-110e-4bf6-9556-dbcc1598e7a9 service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:09.247056 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91b377-110e-4bf6-9556-dbcc1598e7a9 service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:09.247339 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91b377-110e-4bf6-9556-dbcc1598e7a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:09.255441 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91b377-110e-4bf6-9556-dbcc1598e7a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:09.257086 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91b377-110e-4bf6-9556-dbcc1598e7a9 service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:09.266460 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 512/1018] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:09.347361 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7133c61-3fac-4250-b9ac-929c10fef0dc None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:09.347637 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7133c61-3fac-4250-b9ac-929c10fef0dc None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:09.347929 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7133c61-3fac-4250-b9ac-929c10fef0dc None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:09.349360 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 507/1019] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:09.355850 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e580b6-56d7-4061-9a64-d7193ebbd547 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:09.356228 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e580b6-56d7-4061-9a64-d7193ebbd547 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:09.356577 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e580b6-56d7-4061-9a64-d7193ebbd547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:09.369891 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:30:09.376734 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-08e580b6-56d7-4061-9a64-d7193ebbd547 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:09.377974 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-08e580b6-56d7-4061-9a64-d7193ebbd547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:09.386279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 513/1020] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:30:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:09.444808 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fe6fb-694a-48fe-8d00-e48571c55549 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:09.445096 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fe6fb-694a-48fe-8d00-e48571c55549 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:09.445377 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fe6fb-694a-48fe-8d00-e48571c55549 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:09.446754 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 508/1021] 10.222.0.86 () {54 vars in 960 bytes} [Fri Jul 15 16:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:09.452361 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd6ff5-301e-43e9-883d-4f58db05f283 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:09.452654 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd6ff5-301e-43e9-883d-4f58db05f283 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:09.453091 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd6ff5-301e-43e9-883d-4f58db05f283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:09.493020 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-f0fd6ff5-301e-43e9-883d-4f58db05f283 None None] MFA Rules not processed for user `2a518605222244f2974ab19a03e4cf93`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:09.494240 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-f0fd6ff5-301e-43e9-883d-4f58db05f283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:09.560952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 514/1022] 10.222.0.86 () {58 vars in 1057 bytes} [Fri Jul 15 16:30:09 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:09.568465 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fe6fb-694a-48fe-8d00-e48571c55549 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:09.579561 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fe6fb-694a-48fe-8d00-e48571c55549 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:09.583020 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef664550-5930-44e0-a7ca-15ae8b5a95b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a518605222244f2974ab19a03e4cf93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:09.583663 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef664550-5930-44e0-a7ca-15ae8b5a95b2 service glance] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:09.583946 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef664550-5930-44e0-a7ca-15ae8b5a95b2 service glance] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:09.584222 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef664550-5930-44e0-a7ca-15ae8b5a95b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:09.593739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef664550-5930-44e0-a7ca-15ae8b5a95b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:09.595424 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef664550-5930-44e0-a7ca-15ae8b5a95b2 service glance] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:09.605642 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 509/1023] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:11.606663 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b161020-bf3f-497c-801c-032876e6a3b7 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:11.607392 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b161020-bf3f-497c-801c-032876e6a3b7 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:11.607392 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b161020-bf3f-497c-801c-032876e6a3b7 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:11.608612 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 515/1024] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:11.613869 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c4cdb-b8f6-4a59-8fb7-bfd5af6b50a9 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:11.614351 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c4cdb-b8f6-4a59-8fb7-bfd5af6b50a9 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:11.614517 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c4cdb-b8f6-4a59-8fb7-bfd5af6b50a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:11.633149 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-fd0c4cdb-b8f6-4a59-8fb7-bfd5af6b50a9 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:11.634360 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-fd0c4cdb-b8f6-4a59-8fb7-bfd5af6b50a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:11.647944 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 510/1025] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:30:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:11.693102 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b161020-bf3f-497c-801c-032876e6a3b7 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:11.707243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b161020-bf3f-497c-801c-032876e6a3b7 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:11.712770 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9add1-6c61-4d83-9ea6-7664e8a0eb0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:11.713411 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9add1-6c61-4d83-9ea6-7664e8a0eb0f service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:11.713700 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9add1-6c61-4d83-9ea6-7664e8a0eb0f service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:11.713985 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9add1-6c61-4d83-9ea6-7664e8a0eb0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:11.727316 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9add1-6c61-4d83-9ea6-7664e8a0eb0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:11.728918 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9add1-6c61-4d83-9ea6-7664e8a0eb0f service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:11.741265 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 516/1026] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:21.627853 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=11 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:30:21.735425 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=39 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:30:24.704269 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c4c15-a367-4eb6-b449-0883b4c4b773 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:24.704826 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c4c15-a367-4eb6-b449-0883b4c4b773 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:24.704826 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c4c15-a367-4eb6-b449-0883b4c4b773 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:24.706176 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 511/1027] 10.222.0.86 () {54 vars in 918 bytes} [Fri Jul 15 16:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:24.711927 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d69db-cda3-40e1-9608-d0c05340d8b4 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:24.712396 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d69db-cda3-40e1-9608-d0c05340d8b4 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:24.712498 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d69db-cda3-40e1-9608-d0c05340d8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:24.730941 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-687d69db-cda3-40e1-9608-d0c05340d8b4 None None] MFA Rules not processed for user `f716b4b39b3d4547ab937f5a5ffccf08`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:24.732141 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-687d69db-cda3-40e1-9608-d0c05340d8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:24.741157 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 517/1028] 10.222.0.86 () {58 vars in 1015 bytes} [Fri Jul 15 16:30:24 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:24.755255 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bad243-7e88-4c77-a173-42911e9ff9cd None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:24.755546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bad243-7e88-4c77-a173-42911e9ff9cd None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:24.755826 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bad243-7e88-4c77-a173-42911e9ff9cd None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:24.757169 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 512/1029] 10.222.0.86 () {54 vars in 918 bytes} [Fri Jul 15 16:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:24.761917 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e329c-c52a-4bd2-a866-06b7bc6fc5ea None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:24.762212 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e329c-c52a-4bd2-a866-06b7bc6fc5ea None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:24.762496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e329c-c52a-4bd2-a866-06b7bc6fc5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:24.781734 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-c74e329c-c52a-4bd2-a866-06b7bc6fc5ea None None] MFA Rules not processed for user `f34916bd4d56411e8994d1c476885e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:24.782948 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-c74e329c-c52a-4bd2-a866-06b7bc6fc5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:24.791981 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 518/1030] 10.222.0.86 () {58 vars in 1015 bytes} [Fri Jul 15 16:30:24 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 16:30:27.503609 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617afb22-bb70-4104-bded-6655572ca019 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:27.504499 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617afb22-bb70-4104-bded-6655572ca019 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:27.504818 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617afb22-bb70-4104-bded-6655572ca019 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:27.506315 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 513/1031] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 16:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:27.512313 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4bb21-8a1c-42d4-b582-0ca0fe69c136 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:27.512750 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4bb21-8a1c-42d4-b582-0ca0fe69c136 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:27.512913 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4bb21-8a1c-42d4-b582-0ca0fe69c136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:27.531705 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-aba4bb21-8a1c-42d4-b582-0ca0fe69c136 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:27.532889 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-aba4bb21-8a1c-42d4-b582-0ca0fe69c136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:27.540577 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 519/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 16:30:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 16:30:27.584830 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617afb22-bb70-4104-bded-6655572ca019 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:27.598379 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617afb22-bb70-4104-bded-6655572ca019 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:27.603244 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817666a7-1f6d-4fb7-9bcc-3f0e5c9925a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:27.603878 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817666a7-1f6d-4fb7-9bcc-3f0e5c9925a5 service nova] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:27.604161 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817666a7-1f6d-4fb7-9bcc-3f0e5c9925a5 service nova] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:27.604438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817666a7-1f6d-4fb7-9bcc-3f0e5c9925a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:27.612987 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817666a7-1f6d-4fb7-9bcc-3f0e5c9925a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:27.614559 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817666a7-1f6d-4fb7-9bcc-3f0e5c9925a5 service nova] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:27.624476 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 514/1033] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:28.580349 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb963b7-8adb-4246-a875-60642cd1d67b None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:28.580874 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb963b7-8adb-4246-a875-60642cd1d67b None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:28.581000 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb963b7-8adb-4246-a875-60642cd1d67b None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:28.582287 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 520/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 16:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:28.587881 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa548be7-097e-46fe-ad12-339a02a4c0e1 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:28.588307 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa548be7-097e-46fe-ad12-339a02a4c0e1 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:28.588420 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa548be7-097e-46fe-ad12-339a02a4c0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:28.605960 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-aa548be7-097e-46fe-ad12-339a02a4c0e1 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:28.607181 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-aa548be7-097e-46fe-ad12-339a02a4c0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:28.614804 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 515/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 16:30:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:28.834232 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb963b7-8adb-4246-a875-60642cd1d67b None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:28.847953 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb963b7-8adb-4246-a875-60642cd1d67b None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:28.852970 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b88bd-6960-4d8a-9f4d-a80d9287012a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:28.853610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b88bd-6960-4d8a-9f4d-a80d9287012a service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:28.853884 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b88bd-6960-4d8a-9f4d-a80d9287012a service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:28.854162 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b88bd-6960-4d8a-9f4d-a80d9287012a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:28.864983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b88bd-6960-4d8a-9f4d-a80d9287012a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:28.864983 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b88bd-6960-4d8a-9f4d-a80d9287012a service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:28.874081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 521/1036] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:29.770965 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61292a34-770f-49b4-8b9b-6b4560d8b511 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:29.771517 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61292a34-770f-49b4-8b9b-6b4560d8b511 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:29.771687 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61292a34-770f-49b4-8b9b-6b4560d8b511 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:29.773422 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 516/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 16:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:29.778352 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984ef19-4b15-4669-9f7a-349af612f47a None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:29.778812 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984ef19-4b15-4669-9f7a-349af612f47a None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:29.778940 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984ef19-4b15-4669-9f7a-349af612f47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:29.797289 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-2984ef19-4b15-4669-9f7a-349af612f47a None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:29.798471 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-2984ef19-4b15-4669-9f7a-349af612f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:29.806138 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 522/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 16:30:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:29.962239 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61292a34-770f-49b4-8b9b-6b4560d8b511 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:29.976169 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61292a34-770f-49b4-8b9b-6b4560d8b511 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:29.980983 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af9028-30d9-44e3-b392-ac22b26ef0b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:29.981613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af9028-30d9-44e3-b392-ac22b26ef0b7 service nova] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:29.981895 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af9028-30d9-44e3-b392-ac22b26ef0b7 service nova] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:29.982169 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af9028-30d9-44e3-b392-ac22b26ef0b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:29.990103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af9028-30d9-44e3-b392-ac22b26ef0b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:29.991704 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af9028-30d9-44e3-b392-ac22b26ef0b7 service nova] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:30.000961 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 517/1039] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:30.871274 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849261a1-8097-4bfe-ba0b-41d33e73102c None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:30.871696 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849261a1-8097-4bfe-ba0b-41d33e73102c None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:30.871833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849261a1-8097-4bfe-ba0b-41d33e73102c None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:30.873205 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 523/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 16:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:30.878166 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd185d-5570-40b0-81af-bea0edcfef71 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:30.878590 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd185d-5570-40b0-81af-bea0edcfef71 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:30.878774 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd185d-5570-40b0-81af-bea0edcfef71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:30.896341 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-e6cd185d-5570-40b0-81af-bea0edcfef71 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:30.897535 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-e6cd185d-5570-40b0-81af-bea0edcfef71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:30.905988 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 518/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 16:30:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:31.062513 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849261a1-8097-4bfe-ba0b-41d33e73102c None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:31.075840 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849261a1-8097-4bfe-ba0b-41d33e73102c None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:31.080694 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a3c1f-21a2-4293-8865-77c590f75293 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:31.081347 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a3c1f-21a2-4293-8865-77c590f75293 service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:31.081629 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a3c1f-21a2-4293-8865-77c590f75293 service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:31.081907 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a3c1f-21a2-4293-8865-77c590f75293 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:31.089770 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a3c1f-21a2-4293-8865-77c590f75293 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:31.091381 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a3c1f-21a2-4293-8865-77c590f75293 service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:31.100844 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 524/1042] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:31.960112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b20be-b28d-4a05-8ec4-79b87848997e None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:31.960112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b20be-b28d-4a05-8ec4-79b87848997e None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:31.961239 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b20be-b28d-4a05-8ec4-79b87848997e None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:31.962340 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 519/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 16:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:31.967270 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8f4be-4049-41ea-829e-427eba00e79a None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:31.967683 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8f4be-4049-41ea-829e-427eba00e79a None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:31.967830 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8f4be-4049-41ea-829e-427eba00e79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:31.985277 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-7eb8f4be-4049-41ea-829e-427eba00e79a None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:31.986457 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-7eb8f4be-4049-41ea-829e-427eba00e79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:31.994609 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 525/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 16:30:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:32.149285 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b20be-b28d-4a05-8ec4-79b87848997e None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:32.163356 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b20be-b28d-4a05-8ec4-79b87848997e None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:32.168354 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca1e90-7225-42cc-a4c1-e67e2ede5e54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:32.169031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca1e90-7225-42cc-a4c1-e67e2ede5e54 service nova] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:32.169317 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca1e90-7225-42cc-a4c1-e67e2ede5e54 service nova] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:32.169593 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca1e90-7225-42cc-a4c1-e67e2ede5e54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:32.177965 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca1e90-7225-42cc-a4c1-e67e2ede5e54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:32.180113 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca1e90-7225-42cc-a4c1-e67e2ede5e54 service nova] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:32.189548 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 520/1045] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:33.009835 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450e34d-bad3-4a2c-9cf5-950f4eb7ffc0 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:33.010341 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450e34d-bad3-4a2c-9cf5-950f4eb7ffc0 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:33.010341 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450e34d-bad3-4a2c-9cf5-950f4eb7ffc0 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:33.011902 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 526/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 16:30:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:33.016670 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aed31-13f1-473c-a808-3f21596fa610 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:33.017054 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aed31-13f1-473c-a808-3f21596fa610 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:33.017231 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aed31-13f1-473c-a808-3f21596fa610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:33.035013 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-5e2aed31-13f1-473c-a808-3f21596fa610 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:33.036225 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-5e2aed31-13f1-473c-a808-3f21596fa610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:33.043974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 521/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 16:30:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 16:30:33.201022 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450e34d-bad3-4a2c-9cf5-950f4eb7ffc0 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:33.214075 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450e34d-bad3-4a2c-9cf5-950f4eb7ffc0 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:33.219018 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac757bf0-ef5e-4b0c-9bf7-75b3508bf28b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:33.219648 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac757bf0-ef5e-4b0c-9bf7-75b3508bf28b service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:33.219928 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac757bf0-ef5e-4b0c-9bf7-75b3508bf28b service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:33.220203 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac757bf0-ef5e-4b0c-9bf7-75b3508bf28b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:33.228568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac757bf0-ef5e-4b0c-9bf7-75b3508bf28b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:33.230153 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac757bf0-ef5e-4b0c-9bf7-75b3508bf28b service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:33.239334 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 527/1048] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:34.051734 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38ea09-b14e-4eb8-92e3-2cd056058031 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:34.052318 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38ea09-b14e-4eb8-92e3-2cd056058031 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:34.052318 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38ea09-b14e-4eb8-92e3-2cd056058031 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:34.053705 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 522/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 16:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:34.058658 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f79f5-0e01-4c5b-9787-53ea22ae0d11 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:34.059070 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f79f5-0e01-4c5b-9787-53ea22ae0d11 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:34.059255 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f79f5-0e01-4c5b-9787-53ea22ae0d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:34.077542 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-113f79f5-0e01-4c5b-9787-53ea22ae0d11 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:34.078736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-113f79f5-0e01-4c5b-9787-53ea22ae0d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:34.087285 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 528/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 16:30:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 16:30:34.241562 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38ea09-b14e-4eb8-92e3-2cd056058031 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:34.254762 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38ea09-b14e-4eb8-92e3-2cd056058031 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:34.260369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8892cae-aec2-41d6-ba25-ec5cf5d0a838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:34.261001 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8892cae-aec2-41d6-ba25-ec5cf5d0a838 service nova] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:34.261285 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8892cae-aec2-41d6-ba25-ec5cf5d0a838 service nova] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:34.261563 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8892cae-aec2-41d6-ba25-ec5cf5d0a838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:34.269689 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8892cae-aec2-41d6-ba25-ec5cf5d0a838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:34.271322 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8892cae-aec2-41d6-ba25-ec5cf5d0a838 service nova] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:34.280794 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 523/1051] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:35.090656 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85863dc-c69f-4b56-8ad9-5016a2335841 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:35.091193 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85863dc-c69f-4b56-8ad9-5016a2335841 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:35.091310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85863dc-c69f-4b56-8ad9-5016a2335841 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:35.092618 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 529/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 16:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:35.097534 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4906bd-bf8c-4ca4-86b9-22f78d50361c None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:35.097974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4906bd-bf8c-4ca4-86b9-22f78d50361c None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:35.098071 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4906bd-bf8c-4ca4-86b9-22f78d50361c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:35.115558 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-3a4906bd-bf8c-4ca4-86b9-22f78d50361c None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:35.117231 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-3a4906bd-bf8c-4ca4-86b9-22f78d50361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:35.124854 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 524/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 16:30:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:35.280889 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85863dc-c69f-4b56-8ad9-5016a2335841 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:35.294772 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85863dc-c69f-4b56-8ad9-5016a2335841 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:35.304742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460822a-be63-45cd-9169-0c06e2ebbc60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:35.304742 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460822a-be63-45cd-9169-0c06e2ebbc60 service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:35.305204 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460822a-be63-45cd-9169-0c06e2ebbc60 service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:35.306111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460822a-be63-45cd-9169-0c06e2ebbc60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:35.315322 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460822a-be63-45cd-9169-0c06e2ebbc60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:35.316919 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460822a-be63-45cd-9169-0c06e2ebbc60 service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:35.327966 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 530/1054] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:36.143587 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aced84c-5f8f-4079-81e7-fbc175ba1a14 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:36.144097 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aced84c-5f8f-4079-81e7-fbc175ba1a14 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:36.144097 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aced84c-5f8f-4079-81e7-fbc175ba1a14 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:36.145449 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 525/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 16:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:36.150664 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd96db-6d48-4230-9cb1-fee7ebd27b44 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:36.151126 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd96db-6d48-4230-9cb1-fee7ebd27b44 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:36.151292 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd96db-6d48-4230-9cb1-fee7ebd27b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:36.171794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-adbd96db-6d48-4230-9cb1-fee7ebd27b44 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:36.173006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-adbd96db-6d48-4230-9cb1-fee7ebd27b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:36.182116 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 531/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 16:30:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:36.338128 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aced84c-5f8f-4079-81e7-fbc175ba1a14 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:36.352600 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aced84c-5f8f-4079-81e7-fbc175ba1a14 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:36.357818 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8ad10-97b6-42be-afcd-187c1c7ebaac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:36.358454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8ad10-97b6-42be-afcd-187c1c7ebaac service nova] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:36.358738 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8ad10-97b6-42be-afcd-187c1c7ebaac service nova] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:36.359048 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8ad10-97b6-42be-afcd-187c1c7ebaac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:36.368416 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8ad10-97b6-42be-afcd-187c1c7ebaac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:36.370000 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8ad10-97b6-42be-afcd-187c1c7ebaac service nova] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:36.379798 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 526/1057] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:38.522059 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80606f6-ae91-45fc-92e9-8066cb4d85c3 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:38.522612 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80606f6-ae91-45fc-92e9-8066cb4d85c3 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:38.522612 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80606f6-ae91-45fc-92e9-8066cb4d85c3 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:38.524021 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 532/1058] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 16:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:38.529582 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa75a9-8843-4f3e-95e9-94fa988bee23 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:38.530042 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa75a9-8843-4f3e-95e9-94fa988bee23 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:38.530150 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa75a9-8843-4f3e-95e9-94fa988bee23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:38.548532 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-fdfa75a9-8843-4f3e-95e9-94fa988bee23 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:38.549734 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-fdfa75a9-8843-4f3e-95e9-94fa988bee23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:38.558111 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 527/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 16:30:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:38.597435 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80606f6-ae91-45fc-92e9-8066cb4d85c3 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:38.609431 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80606f6-ae91-45fc-92e9-8066cb4d85c3 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:38.612932 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438889c9-3d1b-4bc3-8f99-5819e836d44e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:38.613568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438889c9-3d1b-4bc3-8f99-5819e836d44e service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:38.613845 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438889c9-3d1b-4bc3-8f99-5819e836d44e service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:38.614150 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438889c9-3d1b-4bc3-8f99-5819e836d44e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:38.624087 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438889c9-3d1b-4bc3-8f99-5819e836d44e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:38.625507 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438889c9-3d1b-4bc3-8f99-5819e836d44e service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:38.635197 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 533/1060] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:41.039090 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374d08d-ff77-448c-9089-0671e676a69c None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:41.039601 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374d08d-ff77-448c-9089-0671e676a69c None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:41.039601 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374d08d-ff77-448c-9089-0671e676a69c None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:41.040936 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 528/1061] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 16:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:41.046557 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e430d-2b95-4c36-9c41-5507bffc403d None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:41.047071 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e430d-2b95-4c36-9c41-5507bffc403d None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:41.047167 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e430d-2b95-4c36-9c41-5507bffc403d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:41.065689 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-ab2e430d-2b95-4c36-9c41-5507bffc403d None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:41.067020 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-ab2e430d-2b95-4c36-9c41-5507bffc403d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:41.079038 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 534/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 16:30:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:41.115453 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374d08d-ff77-448c-9089-0671e676a69c None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:41.127244 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374d08d-ff77-448c-9089-0671e676a69c None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:41.130856 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c929c8b-68c3-45a2-9fad-15111fa0aaf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:41.132085 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c929c8b-68c3-45a2-9fad-15111fa0aaf8 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:41.132375 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c929c8b-68c3-45a2-9fad-15111fa0aaf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:41.132655 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c929c8b-68c3-45a2-9fad-15111fa0aaf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:41.141921 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c929c8b-68c3-45a2-9fad-15111fa0aaf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:41.143390 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c929c8b-68c3-45a2-9fad-15111fa0aaf8 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:41.153004 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 529/1063] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:43.733171 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b451a-e107-41b6-823d-7edbbf0461d2 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:43.733722 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b451a-e107-41b6-823d-7edbbf0461d2 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:43.733722 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b451a-e107-41b6-823d-7edbbf0461d2 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:43.735140 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 535/1064] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 16:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:43.740473 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cf28a-2e8e-4320-bda3-b92512657434 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:43.741490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cf28a-2e8e-4320-bda3-b92512657434 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:43.741622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cf28a-2e8e-4320-bda3-b92512657434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:43.759684 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-783cf28a-2e8e-4320-bda3-b92512657434 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:43.760891 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-783cf28a-2e8e-4320-bda3-b92512657434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:43.768755 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 530/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 16:30:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:43.808796 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b451a-e107-41b6-823d-7edbbf0461d2 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:43.819668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b451a-e107-41b6-823d-7edbbf0461d2 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:43.823446 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4d259-529e-4b99-a801-17ab60eeeec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:43.824078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4d259-529e-4b99-a801-17ab60eeeec1 service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:43.824364 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4d259-529e-4b99-a801-17ab60eeeec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:43.824640 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4d259-529e-4b99-a801-17ab60eeeec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:43.833724 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4d259-529e-4b99-a801-17ab60eeeec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:43.835222 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4d259-529e-4b99-a801-17ab60eeeec1 service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:43.844612 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 536/1066] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:46.179806 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7d55a-e34e-4631-bb9b-4dfa159cccd9 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:46.180333 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7d55a-e34e-4631-bb9b-4dfa159cccd9 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:46.180425 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7d55a-e34e-4631-bb9b-4dfa159cccd9 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:46.181780 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 531/1067] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 16:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:46.187385 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316b041-fc79-4a1a-8463-3dd7217da991 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:46.187830 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316b041-fc79-4a1a-8463-3dd7217da991 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:46.188004 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316b041-fc79-4a1a-8463-3dd7217da991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:46.206260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-4316b041-fc79-4a1a-8463-3dd7217da991 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:46.207671 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-4316b041-fc79-4a1a-8463-3dd7217da991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:46.217470 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 537/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 16:30:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:46.259762 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7d55a-e34e-4631-bb9b-4dfa159cccd9 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:46.270471 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7d55a-e34e-4631-bb9b-4dfa159cccd9 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:46.274071 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b958a16-b3dc-4491-9a92-54e4ef70ee8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:46.274713 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b958a16-b3dc-4491-9a92-54e4ef70ee8e service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:46.275039 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b958a16-b3dc-4491-9a92-54e4ef70ee8e service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:46.275319 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b958a16-b3dc-4491-9a92-54e4ef70ee8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:46.285375 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b958a16-b3dc-4491-9a92-54e4ef70ee8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:46.286820 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b958a16-b3dc-4491-9a92-54e4ef70ee8e service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:46.297342 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 532/1069] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:48.649292 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccb61c-129b-4f24-b31a-4d21c03c718f None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:48.649831 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccb61c-129b-4f24-b31a-4d21c03c718f None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:48.649957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccb61c-129b-4f24-b31a-4d21c03c718f None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:48.651305 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 538/1070] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 16:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:48.656491 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82d73e-f2ad-4029-a7d7-0f6f4dedf78f None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:48.656885 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82d73e-f2ad-4029-a7d7-0f6f4dedf78f None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:48.657073 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82d73e-f2ad-4029-a7d7-0f6f4dedf78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:48.674478 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-1b82d73e-f2ad-4029-a7d7-0f6f4dedf78f None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:48.675713 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-1b82d73e-f2ad-4029-a7d7-0f6f4dedf78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:48.683999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 533/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 16:30:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:48.722798 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccb61c-129b-4f24-b31a-4d21c03c718f None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:48.733257 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccb61c-129b-4f24-b31a-4d21c03c718f None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:48.736682 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813f3af-22e0-4ac0-8526-d0b2b28a44b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:48.737304 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813f3af-22e0-4ac0-8526-d0b2b28a44b4 service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:48.737584 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813f3af-22e0-4ac0-8526-d0b2b28a44b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:48.737858 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813f3af-22e0-4ac0-8526-d0b2b28a44b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:48.747467 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813f3af-22e0-4ac0-8526-d0b2b28a44b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:48.748894 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813f3af-22e0-4ac0-8526-d0b2b28a44b4 service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:48.759130 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 539/1072] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:51.023036 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d32a0-086e-4a9c-9646-2d66b57f4c3e None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:51.023583 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d32a0-086e-4a9c-9646-2d66b57f4c3e None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:51.023583 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d32a0-086e-4a9c-9646-2d66b57f4c3e None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:51.024828 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 534/1073] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 16:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:51.029929 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dce4a3-2541-4e10-b80b-1f8355ee8b86 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:51.030363 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dce4a3-2541-4e10-b80b-1f8355ee8b86 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:51.030468 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dce4a3-2541-4e10-b80b-1f8355ee8b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:51.047957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-29dce4a3-2541-4e10-b80b-1f8355ee8b86 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:51.049163 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-29dce4a3-2541-4e10-b80b-1f8355ee8b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:51.057453 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 540/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 16:30:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:51.096010 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d32a0-086e-4a9c-9646-2d66b57f4c3e None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:51.107145 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d32a0-086e-4a9c-9646-2d66b57f4c3e None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:51.110507 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957d773-4140-42b9-8eb6-35a817d3ca85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:51.111169 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957d773-4140-42b9-8eb6-35a817d3ca85 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:51.111451 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957d773-4140-42b9-8eb6-35a817d3ca85 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:51.111725 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957d773-4140-42b9-8eb6-35a817d3ca85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:51.121008 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957d773-4140-42b9-8eb6-35a817d3ca85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:51.122418 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957d773-4140-42b9-8eb6-35a817d3ca85 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:51.131568 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 535/1075] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:53.383081 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068560-75fe-4965-bfd3-0dac17d6fa28 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:53.383589 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068560-75fe-4965-bfd3-0dac17d6fa28 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:53.383589 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068560-75fe-4965-bfd3-0dac17d6fa28 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:53.384990 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 541/1076] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 16:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:53.390096 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79887996-26ea-4a58-a8d4-4d0566521219 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:53.390475 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79887996-26ea-4a58-a8d4-4d0566521219 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:53.390654 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79887996-26ea-4a58-a8d4-4d0566521219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:53.396633 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=70 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:30:53.409362 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-79887996-26ea-4a58-a8d4-4d0566521219 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:53.410546 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-79887996-26ea-4a58-a8d4-4d0566521219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:53.418684 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 536/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 16:30:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:53.456997 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32068560-75fe-4965-bfd3-0dac17d6fa28 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:53.462737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=73 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:30:53.469021 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32068560-75fe-4965-bfd3-0dac17d6fa28 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:53.472471 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2e122-27ca-4e4b-859a-c7062e7f9a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:53.473133 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2e122-27ca-4e4b-859a-c7062e7f9a47 service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:53.473418 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2e122-27ca-4e4b-859a-c7062e7f9a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:53.473715 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2e122-27ca-4e4b-859a-c7062e7f9a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:53.482943 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2e122-27ca-4e4b-859a-c7062e7f9a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:53.484389 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2e122-27ca-4e4b-859a-c7062e7f9a47 service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:53.494179 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 542/1078] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:55.767606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95614f21-cd80-48cc-bc07-40c30f2670fb None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:55.768135 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95614f21-cd80-48cc-bc07-40c30f2670fb None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:55.768135 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95614f21-cd80-48cc-bc07-40c30f2670fb None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:55.769446 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 537/1079] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 16:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:55.775262 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187b963-e759-47b2-b333-96ec7fc8c697 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:55.775644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187b963-e759-47b2-b333-96ec7fc8c697 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:55.775832 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187b963-e759-47b2-b333-96ec7fc8c697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:55.793021 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-4187b963-e759-47b2-b333-96ec7fc8c697 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:55.794211 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-4187b963-e759-47b2-b333-96ec7fc8c697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:55.801851 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 543/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 16:30:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:55.840794 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95614f21-cd80-48cc-bc07-40c30f2670fb None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:55.851469 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95614f21-cd80-48cc-bc07-40c30f2670fb None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:55.855036 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac3416-585b-46ed-b37a-9ab11bd21e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:55.855668 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac3416-585b-46ed-b37a-9ab11bd21e28 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:55.855955 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac3416-585b-46ed-b37a-9ab11bd21e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:55.856236 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac3416-585b-46ed-b37a-9ab11bd21e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:55.865441 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac3416-585b-46ed-b37a-9ab11bd21e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:55.866885 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac3416-585b-46ed-b37a-9ab11bd21e28 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:55.876336 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 538/1081] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:30:58.103453 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa215f84-ac68-49db-a7a5-c784c53a0515 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:58.104042 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa215f84-ac68-49db-a7a5-c784c53a0515 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:58.104042 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa215f84-ac68-49db-a7a5-c784c53a0515 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:58.105354 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 544/1082] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 16:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:30:58.110511 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9837d-afec-4386-8f1d-4f6170f272f5 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:58.110934 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9837d-afec-4386-8f1d-4f6170f272f5 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:58.111115 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9837d-afec-4386-8f1d-4f6170f272f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:58.128514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-64e9837d-afec-4386-8f1d-4f6170f272f5 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:30:58.129647 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-64e9837d-afec-4386-8f1d-4f6170f272f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:30:58.137895 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 539/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 16:30:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:30:58.175273 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa215f84-ac68-49db-a7a5-c784c53a0515 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:30:58.185690 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa215f84-ac68-49db-a7a5-c784c53a0515 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:30:58.189132 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee4517-b0e7-41f9-a91b-f98036b5ce73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:30:58.189753 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee4517-b0e7-41f9-a91b-f98036b5ce73 service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:30:58.190036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee4517-b0e7-41f9-a91b-f98036b5ce73 service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:30:58.190311 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee4517-b0e7-41f9-a91b-f98036b5ce73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:30:58.199684 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee4517-b0e7-41f9-a91b-f98036b5ce73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:30:58.201090 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee4517-b0e7-41f9-a91b-f98036b5ce73 service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:30:58.210857 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 545/1084] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:30:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:31:00.443275 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc628f23-8723-4488-8326-27bd9dfb36be None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:00.444375 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc628f23-8723-4488-8326-27bd9dfb36be None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:00.444375 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc628f23-8723-4488-8326-27bd9dfb36be None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:00.445712 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 540/1085] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 16:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:31:00.451109 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2fd89-5218-4554-b8a7-c85434a1a607 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:00.451513 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2fd89-5218-4554-b8a7-c85434a1a607 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:00.451668 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2fd89-5218-4554-b8a7-c85434a1a607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:00.469720 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-63e2fd89-5218-4554-b8a7-c85434a1a607 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:31:00.470952 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-63e2fd89-5218-4554-b8a7-c85434a1a607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:31:00.478714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 546/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 16:31:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:31:00.517018 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc628f23-8723-4488-8326-27bd9dfb36be None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:31:00.528094 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc628f23-8723-4488-8326-27bd9dfb36be None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:31:00.531625 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f862e-fb6c-4769-b500-d42447fcbfcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:31:00.532293 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f862e-fb6c-4769-b500-d42447fcbfcb service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:00.532576 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f862e-fb6c-4769-b500-d42447fcbfcb service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:00.532853 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f862e-fb6c-4769-b500-d42447fcbfcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:00.541632 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f862e-fb6c-4769-b500-d42447fcbfcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:31:00.543088 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f862e-fb6c-4769-b500-d42447fcbfcb service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:31:00.552369 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 541/1087] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:31:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:31:10.464722 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=17 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:31:10.548294 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=17 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:31:24.094364 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0e326-c4af-4090-978e-a4e9610e41ec None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:24.094946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0e326-c4af-4090-978e-a4e9610e41ec None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:24.094946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0e326-c4af-4090-978e-a4e9610e41ec None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:24.096316 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 547/1088] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:31:24.101879 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d376d-916a-4470-a62d-0cc6a0192f2c None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:24.102277 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d376d-916a-4470-a62d-0cc6a0192f2c None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:24.102446 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d376d-916a-4470-a62d-0cc6a0192f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:24.120501 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-b42d376d-916a-4470-a62d-0cc6a0192f2c None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:31:24.121626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-b42d376d-916a-4470-a62d-0cc6a0192f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:31:24.129425 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 542/1089] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:31:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:31:24.180672 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaadeea-dffe-4978-a4a0-71fcd7d8f276 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:24.180960 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaadeea-dffe-4978-a4a0-71fcd7d8f276 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:24.181238 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaadeea-dffe-4978-a4a0-71fcd7d8f276 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:24.182586 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 548/1090] 10.222.0.86 () {54 vars in 960 bytes} [Fri Jul 15 16:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:31:24.188139 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7174f8-2595-4d8d-b173-76009252c80e None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:24.188459 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7174f8-2595-4d8d-b173-76009252c80e None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:24.188744 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7174f8-2595-4d8d-b173-76009252c80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:24.207613 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-6e7174f8-2595-4d8d-b173-76009252c80e None None] MFA Rules not processed for user `2a518605222244f2974ab19a03e4cf93`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:31:24.208796 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-6e7174f8-2595-4d8d-b173-76009252c80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:31:24.215111 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 543/1091] 10.222.0.86 () {58 vars in 1057 bytes} [Fri Jul 15 16:31:24 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:31:24.222054 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaadeea-dffe-4978-a4a0-71fcd7d8f276 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:31:24.232904 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaadeea-dffe-4978-a4a0-71fcd7d8f276 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:31:24.236321 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc6dab-85d6-4951-8dc1-a414a05c08d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a518605222244f2974ab19a03e4cf93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:31:24.236931 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc6dab-85d6-4951-8dc1-a414a05c08d1 service glance] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:24.237211 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc6dab-85d6-4951-8dc1-a414a05c08d1 service glance] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:24.237481 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc6dab-85d6-4951-8dc1-a414a05c08d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:24.246709 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc6dab-85d6-4951-8dc1-a414a05c08d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:31:24.248140 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc6dab-85d6-4951-8dc1-a414a05c08d1 service glance] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:31:24.257242 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 549/1092] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:31:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:31:26.541122 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a79620-dd54-431d-9066-54c15412ba0f None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:26.541678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a79620-dd54-431d-9066-54c15412ba0f None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:26.541779 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a79620-dd54-431d-9066-54c15412ba0f None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:26.543114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 544/1093] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:31:26.548315 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76315b-f99d-4ffd-82c1-e22f6d335ae4 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:26.548716 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76315b-f99d-4ffd-82c1-e22f6d335ae4 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:26.548877 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76315b-f99d-4ffd-82c1-e22f6d335ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:26.566788 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-8a76315b-f99d-4ffd-82c1-e22f6d335ae4 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:31:26.568025 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-8a76315b-f99d-4ffd-82c1-e22f6d335ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:31:26.576133 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 550/1094] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:31:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:31:26.599661 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a79620-dd54-431d-9066-54c15412ba0f None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:31:26.611800 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a79620-dd54-431d-9066-54c15412ba0f None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:31:26.617230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a0f40-c82d-4a93-9b0d-23d2c6fb8c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:31:26.617862 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a0f40-c82d-4a93-9b0d-23d2c6fb8c82 admin admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:26.618170 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a0f40-c82d-4a93-9b0d-23d2c6fb8c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:26.618444 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a0f40-c82d-4a93-9b0d-23d2c6fb8c82 admin admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:26.619188 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a0f40-c82d-4a93-9b0d-23d2c6fb8c82 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:31:26.620937 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: WARNING py.warnings [None req-381a0f40-c82d-4a93-9b0d-23d2c6fb8c82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 16:31:26.620937 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: warnings.warn(msg) Jul 15 16:31:26.620937 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: Jul 15 16:31:26.622056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a0f40-c82d-4a93-9b0d-23d2c6fb8c82 admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:31:26.639558 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 545/1095] 10.222.0.86 () {56 vars in 1108 bytes} [Fri Jul 15 16:31:26 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 16:31:28.891764 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83078a26-1e93-41a3-a88a-c903d066c16e None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:28.892327 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83078a26-1e93-41a3-a88a-c903d066c16e None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:28.892327 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83078a26-1e93-41a3-a88a-c903d066c16e None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:28.893689 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 551/1096] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:31:28.898922 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783ea5a-196e-4907-9104-bfbe45f50f9f None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:28.899375 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783ea5a-196e-4907-9104-bfbe45f50f9f None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:28.899480 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783ea5a-196e-4907-9104-bfbe45f50f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:28.917315 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-7783ea5a-196e-4907-9104-bfbe45f50f9f None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:31:28.918503 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-7783ea5a-196e-4907-9104-bfbe45f50f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:31:28.926142 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 546/1097] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:31:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:31:28.970260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83078a26-1e93-41a3-a88a-c903d066c16e None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:31:28.984243 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83078a26-1e93-41a3-a88a-c903d066c16e None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:31:28.989094 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67791e9a-e4d6-4c6e-a544-754d6a4f3200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:31:28.989777 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67791e9a-e4d6-4c6e-a544-754d6a4f3200 service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:28.990059 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67791e9a-e4d6-4c6e-a544-754d6a4f3200 service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:28.990337 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67791e9a-e4d6-4c6e-a544-754d6a4f3200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:28.998237 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67791e9a-e4d6-4c6e-a544-754d6a4f3200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:31:28.999859 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67791e9a-e4d6-4c6e-a544-754d6a4f3200 service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:31:29.009159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 552/1098] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:31:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:31:31.383350 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28af9ac-fce7-4b2f-be48-f59503c810db None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:31.383956 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28af9ac-fce7-4b2f-be48-f59503c810db None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:31.383956 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28af9ac-fce7-4b2f-be48-f59503c810db None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:31.385490 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 547/1099] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:31:31.390823 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246fd1d-54f5-41e4-84bc-d7f1a8302774 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:31.391286 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246fd1d-54f5-41e4-84bc-d7f1a8302774 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:31.391397 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246fd1d-54f5-41e4-84bc-d7f1a8302774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:31.409084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-9246fd1d-54f5-41e4-84bc-d7f1a8302774 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:31:31.410271 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-9246fd1d-54f5-41e4-84bc-d7f1a8302774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:31:31.418262 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 553/1100] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:31:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:31:31.456448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28af9ac-fce7-4b2f-be48-f59503c810db None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:31:31.467392 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28af9ac-fce7-4b2f-be48-f59503c810db None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:31:31.470802 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d4a02-1d8f-465e-b40d-6b14d31f4f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:31:31.471952 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d4a02-1d8f-465e-b40d-6b14d31f4f08 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:31.472426 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d4a02-1d8f-465e-b40d-6b14d31f4f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:31.472717 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d4a02-1d8f-465e-b40d-6b14d31f4f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:31.481706 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d4a02-1d8f-465e-b40d-6b14d31f4f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:31:31.483167 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d4a02-1d8f-465e-b40d-6b14d31f4f08 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:31:31.492875 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 548/1101] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:31:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 16:31:33.760731 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def81138-7289-4e86-babd-844bd43067a9 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:33.761248 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def81138-7289-4e86-babd-844bd43067a9 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:33.761248 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def81138-7289-4e86-babd-844bd43067a9 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:33.762563 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 554/1102] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:31:33.767959 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864677a-31bb-439d-a667-86c040ffd87a None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:33.768354 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864677a-31bb-439d-a667-86c040ffd87a None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:33.768517 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864677a-31bb-439d-a667-86c040ffd87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:33.787075 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-d864677a-31bb-439d-a667-86c040ffd87a None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:31:33.788276 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-d864677a-31bb-439d-a667-86c040ffd87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:31:33.796061 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 549/1103] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:31:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:31:33.834856 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def81138-7289-4e86-babd-844bd43067a9 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:31:33.845426 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def81138-7289-4e86-babd-844bd43067a9 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:31:33.849551 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e29c09-0650-4d99-91c0-99d1717503bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:31:33.850175 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e29c09-0650-4d99-91c0-99d1717503bb service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:33.850460 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e29c09-0650-4d99-91c0-99d1717503bb service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:33.850738 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e29c09-0650-4d99-91c0-99d1717503bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:33.859505 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e29c09-0650-4d99-91c0-99d1717503bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:31:33.860923 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e29c09-0650-4d99-91c0-99d1717503bb service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:31:33.870648 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 555/1104] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:31:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:31:36.274742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e508330-3f69-4d25-baec-e6564de17258 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:36.275336 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e508330-3f69-4d25-baec-e6564de17258 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:36.275336 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e508330-3f69-4d25-baec-e6564de17258 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:36.276712 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 550/1105] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:31:36.281988 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd665c3-8932-4b8f-b7f8-f59238b15f0b None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:36.282403 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd665c3-8932-4b8f-b7f8-f59238b15f0b None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:36.282545 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd665c3-8932-4b8f-b7f8-f59238b15f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:36.302746 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-ffd665c3-8932-4b8f-b7f8-f59238b15f0b None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:31:36.304006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-ffd665c3-8932-4b8f-b7f8-f59238b15f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:31:36.311799 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 556/1106] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:31:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:31:36.352808 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e508330-3f69-4d25-baec-e6564de17258 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:31:36.363395 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e508330-3f69-4d25-baec-e6564de17258 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:31:36.367610 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd6be0-74f7-4748-ad6a-f46f92b657d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:31:36.368241 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd6be0-74f7-4748-ad6a-f46f92b657d2 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:36.368530 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd6be0-74f7-4748-ad6a-f46f92b657d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:36.368810 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd6be0-74f7-4748-ad6a-f46f92b657d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:36.377742 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd6be0-74f7-4748-ad6a-f46f92b657d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:31:36.379205 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd6be0-74f7-4748-ad6a-f46f92b657d2 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:31:36.388483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 551/1107] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:31:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:31:38.840619 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd99a45-efa1-4d88-b6c5-a0239c1b5500 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:38.841185 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd99a45-efa1-4d88-b6c5-a0239c1b5500 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:38.841185 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd99a45-efa1-4d88-b6c5-a0239c1b5500 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:38.842528 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 557/1108] 10.222.0.86 () {54 vars in 926 bytes} [Fri Jul 15 16:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:31:38.847652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2b8b7-d237-4393-a4c9-567f11430d3d None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:38.848075 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2b8b7-d237-4393-a4c9-567f11430d3d None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:38.848216 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2b8b7-d237-4393-a4c9-567f11430d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:38.866201 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-08f2b8b7-d237-4393-a4c9-567f11430d3d None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:31:38.867427 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-08f2b8b7-d237-4393-a4c9-567f11430d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:31:38.875186 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 552/1109] 10.222.0.86 () {58 vars in 1023 bytes} [Fri Jul 15 16:31:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:31:38.914741 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd99a45-efa1-4d88-b6c5-a0239c1b5500 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:31:38.925235 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd99a45-efa1-4d88-b6c5-a0239c1b5500 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:31:38.929160 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50778068-d5e0-4f5e-9bf0-25bb4658aa8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:31:38.929784 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50778068-d5e0-4f5e-9bf0-25bb4658aa8f service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:31:38.930066 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50778068-d5e0-4f5e-9bf0-25bb4658aa8f service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:31:38.930341 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50778068-d5e0-4f5e-9bf0-25bb4658aa8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:31:38.939396 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50778068-d5e0-4f5e-9bf0-25bb4658aa8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:31:38.940835 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50778068-d5e0-4f5e-9bf0-25bb4658aa8f service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:31:38.950993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 558/1110] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:31:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:31:48.860485 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=33 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:31:48.946845 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=33 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:33:06.543673 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87134566-4832-40d1-b101-486f54cd79c6 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:06.544308 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87134566-4832-40d1-b101-486f54cd79c6 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:06.544308 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87134566-4832-40d1-b101-486f54cd79c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:06.562292 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-87134566-4832-40d1-b101-486f54cd79c6 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:33:06.563666 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-87134566-4832-40d1-b101-486f54cd79c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:33:06.572829 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 553/1111] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:33:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:33:06.580732 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2af06-118d-425b-a624-7fcde76fb163 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:06.581237 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2af06-118d-425b-a624-7fcde76fb163 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:06.581334 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2af06-118d-425b-a624-7fcde76fb163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:06.598708 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-19b2af06-118d-425b-a624-7fcde76fb163 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:33:06.599985 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-19b2af06-118d-425b-a624-7fcde76fb163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:33:06.607693 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 559/1112] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:33:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:33:06.612579 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87134566-4832-40d1-b101-486f54cd79c6 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:33:06.622017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87134566-4832-40d1-b101-486f54cd79c6 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:33:06.626463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526f7b1-3102-4364-8964-dc2fc34458bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:33:06.627272 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f7b1-3102-4364-8964-dc2fc34458bd admin admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:06.628123 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f7b1-3102-4364-8964-dc2fc34458bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:06.628403 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f7b1-3102-4364-8964-dc2fc34458bd admin admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:06.629123 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526f7b1-3102-4364-8964-dc2fc34458bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:33:06.629428 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526f7b1-3102-4364-8964-dc2fc34458bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:33:06.630429 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: WARNING py.warnings [None req-c526f7b1-3102-4364-8964-dc2fc34458bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 16:33:06.630429 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: warnings.warn(msg) Jul 15 16:33:06.630429 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: Jul 15 16:33:06.631320 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526f7b1-3102-4364-8964-dc2fc34458bd admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:33:06.642499 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 554/1113] 10.222.0.86 () {58 vars in 1152 bytes} [Fri Jul 15 16:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:33:06.650402 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2af06-118d-425b-a624-7fcde76fb163 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:33:06.659423 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2af06-118d-425b-a624-7fcde76fb163 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:33:06.663949 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668d8c0-b9fb-4382-8abf-e563ad38ddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:33:06.664588 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668d8c0-b9fb-4382-8abf-e563ad38ddee admin admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:06.664875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668d8c0-b9fb-4382-8abf-e563ad38ddee admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:06.665154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668d8c0-b9fb-4382-8abf-e563ad38ddee admin admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:06.665849 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668d8c0-b9fb-4382-8abf-e563ad38ddee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:33:06.667652 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: WARNING py.warnings [None req-d668d8c0-b9fb-4382-8abf-e563ad38ddee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 16:33:06.667652 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: warnings.warn(msg) Jul 15 16:33:06.667652 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: Jul 15 16:33:06.668834 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668d8c0-b9fb-4382-8abf-e563ad38ddee admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:33:06.694496 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 560/1114] 10.222.0.86 () {60 vars in 1152 bytes} [Fri Jul 15 16:33:06 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:33:06.698961 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526f7b1-3102-4364-8964-dc2fc34458bd admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:33:06.708587 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526f7b1-3102-4364-8964-dc2fc34458bd admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:33:06.762932 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a027d1b-d3b9-40e2-9ed0-3a16866aa9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:33:06.763595 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a027d1b-d3b9-40e2-9ed0-3a16866aa9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:06.763878 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a027d1b-d3b9-40e2-9ed0-3a16866aa9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:06.764537 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a027d1b-d3b9-40e2-9ed0-3a16866aa9f2 admin admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:06.764822 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a027d1b-d3b9-40e2-9ed0-3a16866aa9f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:33:06.765842 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: WARNING py.warnings [None req-4a027d1b-d3b9-40e2-9ed0-3a16866aa9f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 16:33:06.765842 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: warnings.warn(msg) Jul 15 16:33:06.765842 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: Jul 15 16:33:06.767065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a027d1b-d3b9-40e2-9ed0-3a16866aa9f2 admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:33:06.787505 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 555/1115] 10.222.0.86 () {60 vars in 1143 bytes} [Fri Jul 15 16:33:06 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:33:06.791531 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668d8c0-b9fb-4382-8abf-e563ad38ddee admin admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:33:06.801994 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668d8c0-b9fb-4382-8abf-e563ad38ddee admin admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:33:06.806476 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce5d01-5214-49e9-9eef-520a53315334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:33:06.807151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce5d01-5214-49e9-9eef-520a53315334 admin admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:06.807435 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce5d01-5214-49e9-9eef-520a53315334 admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:06.807710 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce5d01-5214-49e9-9eef-520a53315334 admin admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:06.808453 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce5d01-5214-49e9-9eef-520a53315334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:33:06.809451 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: WARNING py.warnings [None req-79ce5d01-5214-49e9-9eef-520a53315334 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 16:33:06.809451 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: warnings.warn(msg) Jul 15 16:33:06.809451 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: Jul 15 16:33:06.810327 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce5d01-5214-49e9-9eef-520a53315334 admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:33:06.824318 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 561/1116] 10.222.0.86 () {58 vars in 1121 bytes} [Fri Jul 15 16:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 16:33:06.827989 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a027d1b-d3b9-40e2-9ed0-3a16866aa9f2 admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:33:06.837628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a027d1b-d3b9-40e2-9ed0-3a16866aa9f2 admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:33:06.842157 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad111ed-7ded-4d2d-aa4c-dd33c954c382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:33:06.842805 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad111ed-7ded-4d2d-aa4c-dd33c954c382 admin admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:06.843123 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad111ed-7ded-4d2d-aa4c-dd33c954c382 admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:06.843403 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad111ed-7ded-4d2d-aa4c-dd33c954c382 admin admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:06.844126 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad111ed-7ded-4d2d-aa4c-dd33c954c382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:33:06.845134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: WARNING py.warnings [None req-1ad111ed-7ded-4d2d-aa4c-dd33c954c382 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 16:33:06.845134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: warnings.warn(msg) Jul 15 16:33:06.845134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: Jul 15 16:33:06.846004 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad111ed-7ded-4d2d-aa4c-dd33c954c382 admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:33:06.859995 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 556/1117] 10.222.0.86 () {58 vars in 1121 bytes} [Fri Jul 15 16:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 16:33:06.864595 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce5d01-5214-49e9-9eef-520a53315334 admin admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:33:06.874589 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce5d01-5214-49e9-9eef-520a53315334 admin admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:33:06.879211 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa27c4-e6c5-43bd-9ec4-9e7dcef7fbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:33:06.880084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa27c4-e6c5-43bd-9ec4-9e7dcef7fbd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:06.880371 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa27c4-e6c5-43bd-9ec4-9e7dcef7fbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:06.880648 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa27c4-e6c5-43bd-9ec4-9e7dcef7fbd2 admin admin] PATH_INFO: `/v3/projects/033267895d694e04a42fc43c4835831e/users/316d8accbace4c11843b485f06e0b88d/roles/3bed7bde1b98412b94a181719432cfa1` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:06.895111 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa27c4-e6c5-43bd-9ec4-9e7dcef7fbd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033267895d694e04a42fc43c4835831e, user_id=316d8accbace4c11843b485f06e0b88d, role_id=3bed7bde1b98412b94a181719432cfa1)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:33:06.896127 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: WARNING py.warnings [None req-c0fa27c4-e6c5-43bd-9ec4-9e7dcef7fbd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 16:33:06.896127 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: warnings.warn(msg) Jul 15 16:33:06.896127 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: Jul 15 16:33:06.898056 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa27c4-e6c5-43bd-9ec4-9e7dcef7fbd2 admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:33:06.910891 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 562/1118] 10.222.0.86 () {60 vars in 1482 bytes} [Fri Jul 15 16:33:06 2022] PUT /identity/v3/projects/033267895d694e04a42fc43c4835831e/users/316d8accbace4c11843b485f06e0b88d/roles/3bed7bde1b98412b94a181719432cfa1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:33:06.923071 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824eaa1-ee81-44e9-bf7f-ef53accf3ff5 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:06.923346 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824eaa1-ee81-44e9-bf7f-ef53accf3ff5 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:06.923655 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824eaa1-ee81-44e9-bf7f-ef53accf3ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:06.949713 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-4824eaa1-ee81-44e9-bf7f-ef53accf3ff5 None None] MFA Rules not processed for user `316d8accbace4c11843b485f06e0b88d`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:33:06.950941 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-4824eaa1-ee81-44e9-bf7f-ef53accf3ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:33:07.012105 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 557/1119] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:33:06 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:33:07.025647 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd64d56-e573-4d99-861a-a7ddd5665033 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:07.026153 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd64d56-e573-4d99-861a-a7ddd5665033 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:07.026662 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd64d56-e573-4d99-861a-a7ddd5665033 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:07.029265 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 563/1120] 10.222.0.86 () {54 vars in 963 bytes} [Fri Jul 15 16:33:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:33:07.034465 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c0a5c-f862-4412-ac41-04b3f2751071 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:07.034763 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c0a5c-f862-4412-ac41-04b3f2751071 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:07.035075 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c0a5c-f862-4412-ac41-04b3f2751071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:07.053914 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-fc2c0a5c-f862-4412-ac41-04b3f2751071 None None] MFA Rules not processed for user `a101281ae1f2474886c1ec214f042d24`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:33:07.055153 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-fc2c0a5c-f862-4412-ac41-04b3f2751071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:33:07.105681 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:33:07.114858 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 558/1121] 10.222.0.86 () {58 vars in 1060 bytes} [Fri Jul 15 16:33:07 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:33:07.122379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd64d56-e573-4d99-861a-a7ddd5665033 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:33:07.132715 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd64d56-e573-4d99-861a-a7ddd5665033 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:33:07.136179 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b650c2c-1578-4157-bb15-cdea6d17e0a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a101281ae1f2474886c1ec214f042d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:33:07.136804 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b650c2c-1578-4157-bb15-cdea6d17e0a7 service cinder] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:07.137090 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b650c2c-1578-4157-bb15-cdea6d17e0a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:07.137367 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b650c2c-1578-4157-bb15-cdea6d17e0a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:07.145492 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b650c2c-1578-4157-bb15-cdea6d17e0a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:33:07.146936 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b650c2c-1578-4157-bb15-cdea6d17e0a7 service cinder] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:33:07.155501 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 564/1122] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:33:07 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:33:07.190724 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef78d8-6505-4500-b4e2-22f46f51a425 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:07.191058 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef78d8-6505-4500-b4e2-22f46f51a425 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:07.191339 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef78d8-6505-4500-b4e2-22f46f51a425 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:07.192643 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 559/1123] 10.222.0.86 () {52 vars in 829 bytes} [Fri Jul 15 16:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:33:07.196308 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b650c2c-1578-4157-bb15-cdea6d17e0a7 service cinder] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:33:07.258231 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b650c2c-1578-4157-bb15-cdea6d17e0a7 service cinder] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:33:07.262771 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac024e0b-0a19-4f76-a727-a4cf1385b4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:33:07.263639 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac024e0b-0a19-4f76-a727-a4cf1385b4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:07.263926 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac024e0b-0a19-4f76-a727-a4cf1385b4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:07.264202 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac024e0b-0a19-4f76-a727-a4cf1385b4a3 admin admin] PATH_INFO: `/v3/users/316d8accbace4c11843b485f06e0b88d` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:07.265438 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac024e0b-0a19-4f76-a727-a4cf1385b4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=316d8accbace4c11843b485f06e0b88d)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:33:07.266442 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: WARNING py.warnings [None req-ac024e0b-0a19-4f76-a727-a4cf1385b4a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 16:33:07.266442 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: warnings.warn(msg) Jul 15 16:33:07.266442 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: Jul 15 16:33:07.267795 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac024e0b-0a19-4f76-a727-a4cf1385b4a3 admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:33:07.331232 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-ac024e0b-0a19-4f76-a727-a4cf1385b4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '316d8accbace4c11843b485f06e0b88d'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:33:07.340771 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-ac024e0b-0a19-4f76-a727-a4cf1385b4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '316d8accbace4c11843b485f06e0b88d'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:33:07.341376 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-ac024e0b-0a19-4f76-a727-a4cf1385b4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '316d8accbace4c11843b485f06e0b88d'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:33:07.359357 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-ac024e0b-0a19-4f76-a727-a4cf1385b4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '316d8accbace4c11843b485f06e0b88d'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:33:07.371323 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-ac024e0b-0a19-4f76-a727-a4cf1385b4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '316d8accbace4c11843b485f06e0b88d'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:33:07.377625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 565/1124] 10.222.0.86 () {58 vars in 1223 bytes} [Fri Jul 15 16:33:07 2022] DELETE /identity/v3/users/316d8accbace4c11843b485f06e0b88d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:33:07.382004 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51869-7aee-4dfc-ba08-aa14d6aee8d2 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:07.382305 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51869-7aee-4dfc-ba08-aa14d6aee8d2 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:07.382586 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51869-7aee-4dfc-ba08-aa14d6aee8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:07.401281 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-19f51869-7aee-4dfc-ba08-aa14d6aee8d2 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:33:07.402454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-19f51869-7aee-4dfc-ba08-aa14d6aee8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:33:07.459304 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 560/1125] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:33:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:33:07.468809 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac024e0b-0a19-4f76-a727-a4cf1385b4a3 admin admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:33:07.470402 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-ac024e0b-0a19-4f76-a727-a4cf1385b4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:33:07.476434 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:33:07.529711 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac024e0b-0a19-4f76-a727-a4cf1385b4a3 admin admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:33:07.533316 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b212bda-50e8-40cb-8d6f-682396b4ecff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:33:07.534588 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b212bda-50e8-40cb-8d6f-682396b4ecff service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:07.534945 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b212bda-50e8-40cb-8d6f-682396b4ecff service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:07.535184 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b212bda-50e8-40cb-8d6f-682396b4ecff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:07.544279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b212bda-50e8-40cb-8d6f-682396b4ecff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:33:07.545704 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b212bda-50e8-40cb-8d6f-682396b4ecff service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:33:07.555025 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 566/1126] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:33:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:33:07.983222 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51869-7aee-4dfc-ba08-aa14d6aee8d2 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:33:07.984708 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-19f51869-7aee-4dfc-ba08-aa14d6aee8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:33:07.996836 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51869-7aee-4dfc-ba08-aa14d6aee8d2 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:33:08.002441 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dd1c5-f0e0-432b-b037-66c8dc5b381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:33:08.004010 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd1c5-f0e0-432b-b037-66c8dc5b381f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:33:08.004300 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd1c5-f0e0-432b-b037-66c8dc5b381f admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:33:08.004576 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd1c5-f0e0-432b-b037-66c8dc5b381f admin admin] PATH_INFO: `/v3/projects/033267895d694e04a42fc43c4835831e` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:33:08.005871 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581dd1c5-f0e0-432b-b037-66c8dc5b381f admin admin] RBAC: Authorizing `identity:delete_project(project_id=033267895d694e04a42fc43c4835831e)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:33:08.007478 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: WARNING py.warnings [None req-581dd1c5-f0e0-432b-b037-66c8dc5b381f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 16:33:08.007478 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: warnings.warn(msg) Jul 15 16:33:08.007478 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: Jul 15 16:33:08.008853 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581dd1c5-f0e0-432b-b037-66c8dc5b381f admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:33:08.069202 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-581dd1c5-f0e0-432b-b037-66c8dc5b381f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033267895d694e04a42fc43c4835831e', 'request_id': 'req-581dd1c5-f0e0-432b-b037-66c8dc5b381f'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:33:08.075931 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-581dd1c5-f0e0-432b-b037-66c8dc5b381f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033267895d694e04a42fc43c4835831e', 'request_id': 'req-581dd1c5-f0e0-432b-b037-66c8dc5b381f'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:33:08.088782 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-581dd1c5-f0e0-432b-b037-66c8dc5b381f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033267895d694e04a42fc43c4835831e', 'request_id': 'req-581dd1c5-f0e0-432b-b037-66c8dc5b381f'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:33:08.102988 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-581dd1c5-f0e0-432b-b037-66c8dc5b381f admin admin] The token cache is being invalidate because project 033267895d694e04a42fc43c4835831e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 16:33:08.103274 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-581dd1c5-f0e0-432b-b037-66c8dc5b381f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:33:08.103881 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-581dd1c5-f0e0-432b-b037-66c8dc5b381f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:33:08.105497 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 561/1127] 10.222.0.86 () {58 vars in 1232 bytes} [Fri Jul 15 16:33:07 2022] DELETE /identity/v3/projects/033267895d694e04a42fc43c4835831e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:33:17.550910 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=25 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:33:18.099971 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:34:32.994238 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91544a-0b19-43cf-909a-3619021a2843 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:32.994795 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91544a-0b19-43cf-909a-3619021a2843 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:32.994795 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91544a-0b19-43cf-909a-3619021a2843 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:32.996271 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 567/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 16:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:34:33.000977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e09ab9-dfa8-414e-af37-7a36f93df1bb None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:33.001423 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e09ab9-dfa8-414e-af37-7a36f93df1bb None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:33.001521 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e09ab9-dfa8-414e-af37-7a36f93df1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:33.067598 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-a6e09ab9-dfa8-414e-af37-7a36f93df1bb None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:34:33.069157 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-a6e09ab9-dfa8-414e-af37-7a36f93df1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:34:33.160360 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 562/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 16:34:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:34:33.320332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91544a-0b19-43cf-909a-3619021a2843 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:34:33.321947 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-8c91544a-0b19-43cf-909a-3619021a2843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:34:33.407993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91544a-0b19-43cf-909a-3619021a2843 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:34:33.412984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e67335-76b8-4a97-83c0-aeff0740cd6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:34:33.413619 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e67335-76b8-4a97-83c0-aeff0740cd6d service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:33.413900 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e67335-76b8-4a97-83c0-aeff0740cd6d service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:33.414173 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e67335-76b8-4a97-83c0-aeff0740cd6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:33.422238 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e67335-76b8-4a97-83c0-aeff0740cd6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:34:33.423936 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e67335-76b8-4a97-83c0-aeff0740cd6d service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:34:33.433578 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 568/1130] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:34:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:34:34.267575 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72717f4-d832-4190-8bd8-7118d54dd0a9 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:34.268125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72717f4-d832-4190-8bd8-7118d54dd0a9 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:34.268231 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72717f4-d832-4190-8bd8-7118d54dd0a9 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:34.269548 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 563/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 16:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:34:34.274427 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865fa8d-542f-43c4-bdc7-624c924f49af None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:34.274848 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865fa8d-542f-43c4-bdc7-624c924f49af None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:34.275033 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865fa8d-542f-43c4-bdc7-624c924f49af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:34.293003 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-b865fa8d-542f-43c4-bdc7-624c924f49af None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:34:34.294192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-b865fa8d-542f-43c4-bdc7-624c924f49af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:34:34.302310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 569/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 16:34:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:34:34.463214 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72717f4-d832-4190-8bd8-7118d54dd0a9 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:34:34.477208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72717f4-d832-4190-8bd8-7118d54dd0a9 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:34:34.482072 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d23934-b78d-4ec0-b401-f77de0f7ceb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:34:34.482728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d23934-b78d-4ec0-b401-f77de0f7ceb6 service nova] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:34.483054 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d23934-b78d-4ec0-b401-f77de0f7ceb6 service nova] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:34.483332 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d23934-b78d-4ec0-b401-f77de0f7ceb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:34.491389 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d23934-b78d-4ec0-b401-f77de0f7ceb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:34:34.492955 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d23934-b78d-4ec0-b401-f77de0f7ceb6 service nova] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:34:34.502213 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 564/1133] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:34:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:34:40.062109 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e4baf-0a7b-40d2-a052-d07819da3c6e None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:40.062704 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e4baf-0a7b-40d2-a052-d07819da3c6e None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:40.062704 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e4baf-0a7b-40d2-a052-d07819da3c6e None None] PATH_INFO: `/v3` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:40.064044 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 570/1134] 10.222.0.96 () {54 vars in 925 bytes} [Fri Jul 15 16:34:40 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 16:34:40.070641 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872ea6e-324a-4174-8e04-689415e4b2b4 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:40.071077 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872ea6e-324a-4174-8e04-689415e4b2b4 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:40.071262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872ea6e-324a-4174-8e04-689415e4b2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:40.098200 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-8872ea6e-324a-4174-8e04-689415e4b2b4 None None] MFA Rules not processed for user `f716b4b39b3d4547ab937f5a5ffccf08`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:34:40.099419 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-8872ea6e-324a-4174-8e04-689415e4b2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:34:40.154443 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:34:40.164695 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 565/1135] 10.222.0.96 () {58 vars in 1015 bytes} [Fri Jul 15 16:34:40 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:34:44.260524 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256065ff-2d02-47d9-8b88-6505b1d2388b None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:44.261069 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256065ff-2d02-47d9-8b88-6505b1d2388b None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:44.261069 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256065ff-2d02-47d9-8b88-6505b1d2388b None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:44.262428 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 571/1136] 10.222.0.86 () {54 vars in 960 bytes} [Fri Jul 15 16:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:34:44.267414 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eca8f-e3aa-407e-bff4-9c6179375375 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:44.267861 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eca8f-e3aa-407e-bff4-9c6179375375 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:44.268012 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eca8f-e3aa-407e-bff4-9c6179375375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:44.286278 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-e38eca8f-e3aa-407e-bff4-9c6179375375 None None] MFA Rules not processed for user `f716b4b39b3d4547ab937f5a5ffccf08`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:34:44.287492 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-e38eca8f-e3aa-407e-bff4-9c6179375375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:34:44.287719 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=42 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:34:44.296822 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 566/1137] 10.222.0.86 () {58 vars in 1057 bytes} [Fri Jul 15 16:34:44 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:34:44.304253 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256065ff-2d02-47d9-8b88-6505b1d2388b None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:34:44.317112 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256065ff-2d02-47d9-8b88-6505b1d2388b None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:34:44.322165 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b1b66-32b8-4c67-b24d-55f9f6a6998b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f716b4b39b3d4547ab937f5a5ffccf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:34:44.322788 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b1b66-32b8-4c67-b24d-55f9f6a6998b service placement] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:44.323103 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b1b66-32b8-4c67-b24d-55f9f6a6998b service placement] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:44.323379 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b1b66-32b8-4c67-b24d-55f9f6a6998b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:44.336158 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b1b66-32b8-4c67-b24d-55f9f6a6998b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:34:44.337747 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b1b66-32b8-4c67-b24d-55f9f6a6998b service placement] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:34:44.347214 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 572/1138] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:34:44 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:34:45.737392 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2afa-a2cd-4102-9432-8b83f6fdd857 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:45.737935 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2afa-a2cd-4102-9432-8b83f6fdd857 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:45.737935 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2afa-a2cd-4102-9432-8b83f6fdd857 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:45.739365 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 567/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 16:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 16:34:45.744721 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cfb42-1b97-4456-be08-684ae7c66c3b None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:45.745137 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cfb42-1b97-4456-be08-684ae7c66c3b None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:45.745284 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cfb42-1b97-4456-be08-684ae7c66c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:45.764072 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-2d5cfb42-1b97-4456-be08-684ae7c66c3b None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:34:45.765266 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-2d5cfb42-1b97-4456-be08-684ae7c66c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:34:45.772956 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 573/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 16:34:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:34:45.936454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b2afa-a2cd-4102-9432-8b83f6fdd857 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:34:45.951368 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b2afa-a2cd-4102-9432-8b83f6fdd857 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:34:45.956173 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e53df1-2b5f-44c5-b469-4bb25c57b92e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:34:45.956800 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e53df1-2b5f-44c5-b469-4bb25c57b92e service nova] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:45.957112 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e53df1-2b5f-44c5-b469-4bb25c57b92e service nova] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:45.957387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e53df1-2b5f-44c5-b469-4bb25c57b92e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:45.965460 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e53df1-2b5f-44c5-b469-4bb25c57b92e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:34:45.967056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e53df1-2b5f-44c5-b469-4bb25c57b92e service nova] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:34:45.976189 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 568/1141] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:34:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 16:34:46.799594 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fda7fb-61f4-4347-8c78-67b22f4e6f12 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:46.800201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fda7fb-61f4-4347-8c78-67b22f4e6f12 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:46.800201 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fda7fb-61f4-4347-8c78-67b22f4e6f12 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:46.801457 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 574/1142] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 16:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:34:46.806198 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ff205-63c7-4c0b-b5b9-baf5d4d0dd2c None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:46.806587 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ff205-63c7-4c0b-b5b9-baf5d4d0dd2c None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:46.806762 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ff205-63c7-4c0b-b5b9-baf5d4d0dd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:46.825763 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-155ff205-63c7-4c0b-b5b9-baf5d4d0dd2c None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:34:46.827076 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-155ff205-63c7-4c0b-b5b9-baf5d4d0dd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:34:46.834817 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 569/1143] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 16:34:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:34:46.991984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fda7fb-61f4-4347-8c78-67b22f4e6f12 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:34:47.005211 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fda7fb-61f4-4347-8c78-67b22f4e6f12 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:34:47.010635 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf706d0b-33ef-4c5b-89a5-57518627e25e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:34:47.011297 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf706d0b-33ef-4c5b-89a5-57518627e25e service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:47.011582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf706d0b-33ef-4c5b-89a5-57518627e25e service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:47.011861 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf706d0b-33ef-4c5b-89a5-57518627e25e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:47.020221 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf706d0b-33ef-4c5b-89a5-57518627e25e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:34:47.021807 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf706d0b-33ef-4c5b-89a5-57518627e25e service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:34:47.031636 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 575/1144] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:34:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:34:51.152652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c27ed6-a339-4068-812b-cf3c5709094e None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:51.153177 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c27ed6-a339-4068-812b-cf3c5709094e None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:51.153177 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c27ed6-a339-4068-812b-cf3c5709094e None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:51.154476 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 570/1145] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 16:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:34:51.159566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e88f8-61ae-4011-b64f-583ff286e069 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:51.159984 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e88f8-61ae-4011-b64f-583ff286e069 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:51.160141 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e88f8-61ae-4011-b64f-583ff286e069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:51.180241 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-b89e88f8-61ae-4011-b64f-583ff286e069 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:34:51.181456 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-b89e88f8-61ae-4011-b64f-583ff286e069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:34:51.189543 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 576/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 16:34:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:34:51.227764 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c27ed6-a339-4068-812b-cf3c5709094e None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:34:51.229456 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-d7c27ed6-a339-4068-812b-cf3c5709094e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:34:51.288445 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c27ed6-a339-4068-812b-cf3c5709094e None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:34:51.292106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a183f-221f-4323-a204-c4b072e82071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:34:51.292748 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a183f-221f-4323-a204-c4b072e82071 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:51.293034 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a183f-221f-4323-a204-c4b072e82071 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:51.293310 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a183f-221f-4323-a204-c4b072e82071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:51.302056 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a183f-221f-4323-a204-c4b072e82071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:34:51.303563 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a183f-221f-4323-a204-c4b072e82071 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:34:51.313453 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 571/1147] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:34:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:34:53.505985 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec7098-3b6c-452c-9dfc-d68bf7cd0421 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:53.506550 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec7098-3b6c-452c-9dfc-d68bf7cd0421 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:53.506550 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec7098-3b6c-452c-9dfc-d68bf7cd0421 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:53.508473 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 577/1148] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 16:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:34:53.513783 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffc230-e051-4b36-a70e-34d9573338b4 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:53.514197 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffc230-e051-4b36-a70e-34d9573338b4 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:53.514388 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffc230-e051-4b36-a70e-34d9573338b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:53.532827 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-c2ffc230-e051-4b36-a70e-34d9573338b4 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:34:53.534324 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-c2ffc230-e051-4b36-a70e-34d9573338b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:34:53.543480 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 572/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 16:34:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:34:53.580009 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec7098-3b6c-452c-9dfc-d68bf7cd0421 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:34:53.591359 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec7098-3b6c-452c-9dfc-d68bf7cd0421 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:34:53.594938 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c1944-d758-44ec-bf0a-91169a782a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:34:53.595571 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c1944-d758-44ec-bf0a-91169a782a4f service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:53.595857 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c1944-d758-44ec-bf0a-91169a782a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:53.596136 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c1944-d758-44ec-bf0a-91169a782a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:53.604913 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c1944-d758-44ec-bf0a-91169a782a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:34:53.606344 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c1944-d758-44ec-bf0a-91169a782a4f service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:34:53.615737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 578/1150] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:34:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:34:57.415676 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83d799-4388-429e-99ce-9ba0910d45aa None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:57.416261 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83d799-4388-429e-99ce-9ba0910d45aa None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:57.416261 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83d799-4388-429e-99ce-9ba0910d45aa None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:57.417678 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 573/1151] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 16:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:34:57.422733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8904e-2b1c-4d3c-9d30-f3aa1832d370 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:57.423169 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8904e-2b1c-4d3c-9d30-f3aa1832d370 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:57.423334 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8904e-2b1c-4d3c-9d30-f3aa1832d370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:57.441105 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-dde8904e-2b1c-4d3c-9d30-f3aa1832d370 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:34:57.442335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-dde8904e-2b1c-4d3c-9d30-f3aa1832d370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:34:57.450782 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 579/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 16:34:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:34:57.719409 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83d799-4388-429e-99ce-9ba0910d45aa None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:34:57.721046 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-7e83d799-4388-429e-99ce-9ba0910d45aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:34:57.777652 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83d799-4388-429e-99ce-9ba0910d45aa None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:34:57.781155 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f563bcf-2841-4617-90f5-05b4ff94fc2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a101281ae1f2474886c1ec214f042d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:34:57.781792 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f563bcf-2841-4617-90f5-05b4ff94fc2b service cinder] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:34:57.782080 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f563bcf-2841-4617-90f5-05b4ff94fc2b service cinder] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:34:57.782360 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f563bcf-2841-4617-90f5-05b4ff94fc2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:34:57.791154 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f563bcf-2841-4617-90f5-05b4ff94fc2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:34:57.792580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f563bcf-2841-4617-90f5-05b4ff94fc2b service cinder] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:34:57.802131 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 574/1153] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:34:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:35:00.047186 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36a18a-485e-4544-a5a3-6288fc5d2c86 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:35:00.047741 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36a18a-485e-4544-a5a3-6288fc5d2c86 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:35:00.047839 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36a18a-485e-4544-a5a3-6288fc5d2c86 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:35:00.049149 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 580/1154] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 16:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:35:00.054306 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaf628-395d-4a77-b4d7-28050ace22fa None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:35:00.054737 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaf628-395d-4a77-b4d7-28050ace22fa None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:35:00.054876 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaf628-395d-4a77-b4d7-28050ace22fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:35:00.072797 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-7ddaf628-395d-4a77-b4d7-28050ace22fa None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:35:00.073977 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-7ddaf628-395d-4a77-b4d7-28050ace22fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:35:00.081947 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 575/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 16:35:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:35:00.352105 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36a18a-485e-4544-a5a3-6288fc5d2c86 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:35:00.353786 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-7c36a18a-485e-4544-a5a3-6288fc5d2c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:35:00.366555 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36a18a-485e-4544-a5a3-6288fc5d2c86 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:35:00.370046 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439c16d-a3fc-4aaa-a990-974d8e87d4a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a101281ae1f2474886c1ec214f042d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:35:00.370672 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439c16d-a3fc-4aaa-a990-974d8e87d4a3 service cinder] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:35:00.370999 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439c16d-a3fc-4aaa-a990-974d8e87d4a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:35:00.371269 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439c16d-a3fc-4aaa-a990-974d8e87d4a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:35:00.380060 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439c16d-a3fc-4aaa-a990-974d8e87d4a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:35:00.382009 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439c16d-a3fc-4aaa-a990-974d8e87d4a3 service cinder] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:35:00.391598 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 581/1156] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:35:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:35:10.067308 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=70 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:35:10.387304 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=33 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:36:19.272614 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4479a11-2476-4adb-bc6a-30843b33760b None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.273254 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4479a11-2476-4adb-bc6a-30843b33760b None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.273254 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4479a11-2476-4adb-bc6a-30843b33760b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.273450 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89466c30-b825-48e0-82e5-9b241f615324 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.273853 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89466c30-b825-48e0-82e5-9b241f615324 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.273853 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89466c30-b825-48e0-82e5-9b241f615324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.292331 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-89466c30-b825-48e0-82e5-9b241f615324 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:19.293546 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-89466c30-b825-48e0-82e5-9b241f615324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:19.295315 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-c4479a11-2476-4adb-bc6a-30843b33760b None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:19.296501 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-c4479a11-2476-4adb-bc6a-30843b33760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:19.301399 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 582/1157] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:36:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:19.305198 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 576/1158] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:36:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:19.310318 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387847-6913-4476-931d-c697c2433cba None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.310615 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387847-6913-4476-931d-c697c2433cba None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.310925 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387847-6913-4476-931d-c697c2433cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.312947 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb250019-5c48-4677-98b8-f62836949add None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.313245 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb250019-5c48-4677-98b8-f62836949add None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.313530 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb250019-5c48-4677-98b8-f62836949add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.328700 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-c3387847-6913-4476-931d-c697c2433cba None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:19.329890 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-c3387847-6913-4476-931d-c697c2433cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:19.331330 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-fb250019-5c48-4677-98b8-f62836949add None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:19.332476 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-fb250019-5c48-4677-98b8-f62836949add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:19.338279 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 583/1159] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:36:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:19.340998 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 577/1160] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:36:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:19.343751 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3387847-6913-4476-931d-c697c2433cba None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:19.345261 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb250019-5c48-4677-98b8-f62836949add None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:19.353596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3387847-6913-4476-931d-c697c2433cba None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:19.354713 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb250019-5c48-4677-98b8-f62836949add None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:19.358270 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3ccb0-c874-4e4c-bda1-a63f82c53515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:19.358944 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3ccb0-c874-4e4c-bda1-a63f82c53515 admin admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.359231 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3ccb0-c874-4e4c-bda1-a63f82c53515 admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.359338 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78318224-c0c9-47b4-9f73-dde4bc268cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:19.359506 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3ccb0-c874-4e4c-bda1-a63f82c53515 admin admin] PATH_INFO: `/v3/domains` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.359965 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78318224-c0c9-47b4-9f73-dde4bc268cef admin admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.360228 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3ccb0-c874-4e4c-bda1-a63f82c53515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:36:19.360336 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78318224-c0c9-47b4-9f73-dde4bc268cef admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.360504 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78318224-c0c9-47b4-9f73-dde4bc268cef admin admin] PATH_INFO: `/v3/domains` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.360610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3ccb0-c874-4e4c-bda1-a63f82c53515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:19.361213 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78318224-c0c9-47b4-9f73-dde4bc268cef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 16:36:19.361518 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78318224-c0c9-47b4-9f73-dde4bc268cef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:19.361630 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: WARNING py.warnings [None req-60f3ccb0-c874-4e4c-bda1-a63f82c53515 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 16:36:19.361630 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: warnings.warn(msg) Jul 15 16:36:19.361630 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: Jul 15 16:36:19.362386 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3ccb0-c874-4e4c-bda1-a63f82c53515 admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:19.363099 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78318224-c0c9-47b4-9f73-dde4bc268cef admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:19.374018 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 584/1161] 10.222.0.86 () {58 vars in 1152 bytes} [Fri Jul 15 16:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:36:19.374693 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 578/1162] 10.222.0.86 () {58 vars in 1152 bytes} [Fri Jul 15 16:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 16:36:19.381906 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3ccb0-c874-4e4c-bda1-a63f82c53515 admin admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:19.382531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78318224-c0c9-47b4-9f73-dde4bc268cef admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:19.391530 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3ccb0-c874-4e4c-bda1-a63f82c53515 admin admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:19.392317 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78318224-c0c9-47b4-9f73-dde4bc268cef admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:19.396238 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc06248-5dc8-43bc-8f73-5ea94b176336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:19.396834 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8527e16-e776-4da7-863c-8908ecd088e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:19.397467 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc06248-5dc8-43bc-8f73-5ea94b176336 admin admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.397662 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc06248-5dc8-43bc-8f73-5ea94b176336 admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.397928 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc06248-5dc8-43bc-8f73-5ea94b176336 admin admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.398042 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8527e16-e776-4da7-863c-8908ecd088e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.398257 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8527e16-e776-4da7-863c-8908ecd088e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.398535 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8527e16-e776-4da7-863c-8908ecd088e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.398649 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc06248-5dc8-43bc-8f73-5ea94b176336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:19.399255 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8527e16-e776-4da7-863c-8908ecd088e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:19.400260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: WARNING py.warnings [None req-b8527e16-e776-4da7-863c-8908ecd088e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 16:36:19.400260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: warnings.warn(msg) Jul 15 16:36:19.400260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: Jul 15 16:36:19.400499 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc06248-5dc8-43bc-8f73-5ea94b176336 admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:19.401431 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8527e16-e776-4da7-863c-8908ecd088e2 admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:19.437618 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 585/1163] 10.222.0.86 () {60 vars in 1152 bytes} [Fri Jul 15 16:36:19 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:36:19.438847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 579/1164] 10.222.0.86 () {60 vars in 1152 bytes} [Fri Jul 15 16:36:19 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 16:36:19.441664 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc06248-5dc8-43bc-8f73-5ea94b176336 admin admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:19.443441 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8527e16-e776-4da7-863c-8908ecd088e2 admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:19.504025 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8527e16-e776-4da7-863c-8908ecd088e2 admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:19.506027 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc06248-5dc8-43bc-8f73-5ea94b176336 admin admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:19.509704 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e801a-1bcb-4131-b5d2-059319809774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:19.510351 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e801a-1bcb-4131-b5d2-059319809774 admin admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.510631 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e801a-1bcb-4131-b5d2-059319809774 admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.510736 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede64d36-5dc3-4f5f-b168-f5034f1cb8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:19.510934 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e801a-1bcb-4131-b5d2-059319809774 admin admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.511408 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede64d36-5dc3-4f5f-b168-f5034f1cb8fa admin admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.511622 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e801a-1bcb-4131-b5d2-059319809774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:19.511727 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede64d36-5dc3-4f5f-b168-f5034f1cb8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.511994 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede64d36-5dc3-4f5f-b168-f5034f1cb8fa admin admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.512676 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede64d36-5dc3-4f5f-b168-f5034f1cb8fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:19.513557 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e801a-1bcb-4131-b5d2-059319809774 admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:19.513660 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: WARNING py.warnings [None req-ede64d36-5dc3-4f5f-b168-f5034f1cb8fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 16:36:19.513660 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: warnings.warn(msg) Jul 15 16:36:19.513660 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: Jul 15 16:36:19.514892 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede64d36-5dc3-4f5f-b168-f5034f1cb8fa admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:19.539236 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 580/1165] 10.222.0.86 () {60 vars in 1143 bytes} [Fri Jul 15 16:36:19 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:36:19.539427 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 586/1166] 10.222.0.86 () {60 vars in 1143 bytes} [Fri Jul 15 16:36:19 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 16:36:19.539982 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e801a-1bcb-4131-b5d2-059319809774 admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:19.540257 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede64d36-5dc3-4f5f-b168-f5034f1cb8fa admin admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:19.550562 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e801a-1bcb-4131-b5d2-059319809774 admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:19.552141 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede64d36-5dc3-4f5f-b168-f5034f1cb8fa admin admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:19.556432 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e08012-eab9-4de0-b257-8926e97f562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:19.557267 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadeb95f-e0fd-448c-9946-9c31af42ec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:19.557483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e08012-eab9-4de0-b257-8926e97f562a admin admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.557760 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e08012-eab9-4de0-b257-8926e97f562a admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.558134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e08012-eab9-4de0-b257-8926e97f562a admin admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.558260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadeb95f-e0fd-448c-9946-9c31af42ec22 admin admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.558566 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadeb95f-e0fd-448c-9946-9c31af42ec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.559064 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadeb95f-e0fd-448c-9946-9c31af42ec22 admin admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.559306 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e08012-eab9-4de0-b257-8926e97f562a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:19.560257 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadeb95f-e0fd-448c-9946-9c31af42ec22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:19.561100 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e08012-eab9-4de0-b257-8926e97f562a admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:19.561912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadeb95f-e0fd-448c-9946-9c31af42ec22 admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:19.572399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 581/1167] 10.222.0.86 () {58 vars in 1121 bytes} [Fri Jul 15 16:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 16:36:19.574027 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 587/1168] 10.222.0.86 () {58 vars in 1121 bytes} [Fri Jul 15 16:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 16:36:19.576582 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e08012-eab9-4de0-b257-8926e97f562a admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:19.577643 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadeb95f-e0fd-448c-9946-9c31af42ec22 admin admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:19.586796 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e08012-eab9-4de0-b257-8926e97f562a admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:19.587698 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadeb95f-e0fd-448c-9946-9c31af42ec22 admin admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:19.591324 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596041b-354b-46b0-8e7b-681fb27c904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:19.591959 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596041b-354b-46b0-8e7b-681fb27c904a admin admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.592232 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c71c40-357c-43a3-8bba-aa84ea9147f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:19.592359 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596041b-354b-46b0-8e7b-681fb27c904a admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.592503 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596041b-354b-46b0-8e7b-681fb27c904a admin admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.592872 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c71c40-357c-43a3-8bba-aa84ea9147f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.593158 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c71c40-357c-43a3-8bba-aa84ea9147f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.593259 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596041b-354b-46b0-8e7b-681fb27c904a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:19.593436 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c71c40-357c-43a3-8bba-aa84ea9147f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.594151 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c71c40-357c-43a3-8bba-aa84ea9147f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:19.594767 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596041b-354b-46b0-8e7b-681fb27c904a admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:19.595749 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c71c40-357c-43a3-8bba-aa84ea9147f9 admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:19.605881 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 582/1169] 10.222.0.86 () {58 vars in 1121 bytes} [Fri Jul 15 16:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 16:36:19.610186 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 588/1170] 10.222.0.86 () {58 vars in 1121 bytes} [Fri Jul 15 16:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 16:36:19.610338 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596041b-354b-46b0-8e7b-681fb27c904a admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:19.611128 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c71c40-357c-43a3-8bba-aa84ea9147f9 admin admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:19.619847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596041b-354b-46b0-8e7b-681fb27c904a admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:19.620385 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c71c40-357c-43a3-8bba-aa84ea9147f9 admin admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:19.624366 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27251ef-7822-486e-99c9-08db5199944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:19.625124 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3af34d-318e-40b0-8e68-47c17c87dfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:19.625262 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27251ef-7822-486e-99c9-08db5199944c admin admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.625484 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27251ef-7822-486e-99c9-08db5199944c admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.625753 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27251ef-7822-486e-99c9-08db5199944c admin admin] PATH_INFO: `/v3/projects/da150b61a1ac422f81a915d352b26c0b/users/64a282a6605841719be67d7f6d2f90e0/roles/3bed7bde1b98412b94a181719432cfa1` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.625969 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3af34d-318e-40b0-8e68-47c17c87dfea admin admin] REQUEST_METHOD: `PUT` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.626252 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3af34d-318e-40b0-8e68-47c17c87dfea admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.626526 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3af34d-318e-40b0-8e68-47c17c87dfea admin admin] PATH_INFO: `/v3/projects/e5d257e1ebb043caaf67249e1c0bb6a5/users/691785f55e1c485e8134b7f37d4a7172/roles/3bed7bde1b98412b94a181719432cfa1` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.640938 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3af34d-318e-40b0-8e68-47c17c87dfea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d257e1ebb043caaf67249e1c0bb6a5, user_id=691785f55e1c485e8134b7f37d4a7172, role_id=3bed7bde1b98412b94a181719432cfa1)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:19.641421 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27251ef-7822-486e-99c9-08db5199944c admin admin] RBAC: Authorizing `identity:create_grant(project_id=da150b61a1ac422f81a915d352b26c0b, user_id=64a282a6605841719be67d7f6d2f90e0, role_id=3bed7bde1b98412b94a181719432cfa1)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:19.642509 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: WARNING py.warnings [None req-f27251ef-7822-486e-99c9-08db5199944c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 16:36:19.642509 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: warnings.warn(msg) Jul 15 16:36:19.642509 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: Jul 15 16:36:19.643699 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3af34d-318e-40b0-8e68-47c17c87dfea admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:19.644640 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27251ef-7822-486e-99c9-08db5199944c admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:19.657617 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 589/1171] 10.222.0.86 () {60 vars in 1482 bytes} [Fri Jul 15 16:36:19 2022] PUT /identity/v3/projects/e5d257e1ebb043caaf67249e1c0bb6a5/users/691785f55e1c485e8134b7f37d4a7172/roles/3bed7bde1b98412b94a181719432cfa1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:36:19.658628 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 583/1172] 10.222.0.86 () {60 vars in 1482 bytes} [Fri Jul 15 16:36:19 2022] PUT /identity/v3/projects/da150b61a1ac422f81a915d352b26c0b/users/64a282a6605841719be67d7f6d2f90e0/roles/3bed7bde1b98412b94a181719432cfa1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 16:36:19.663361 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cca7f-363b-4dfd-a20b-360a1ea8ec42 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.663653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cca7f-363b-4dfd-a20b-360a1ea8ec42 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.663931 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cca7f-363b-4dfd-a20b-360a1ea8ec42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.664338 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4714a-b2e3-40a3-bc63-46b7974116bd None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.664636 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4714a-b2e3-40a3-bc63-46b7974116bd None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.664912 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4714a-b2e3-40a3-bc63-46b7974116bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.681498 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-b4f4714a-b2e3-40a3-bc63-46b7974116bd None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:19.681793 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-ea4cca7f-363b-4dfd-a20b-360a1ea8ec42 None None] MFA Rules not processed for user `44293b77272f4265bf2e4dd85cca6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:19.682716 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-b4f4714a-b2e3-40a3-bc63-46b7974116bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:19.683007 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-ea4cca7f-363b-4dfd-a20b-360a1ea8ec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:19.724517 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:36:19.724687 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:36:19.743908 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 590/1173] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:36:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 16:36:19.747169 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 584/1174] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:36:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 16:36:19.754413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4714a-b2e3-40a3-bc63-46b7974116bd None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:19.754572 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cca7f-363b-4dfd-a20b-360a1ea8ec42 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:19.755820 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-b4f4714a-b2e3-40a3-bc63-46b7974116bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:19.808847 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cca7f-363b-4dfd-a20b-360a1ea8ec42 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:19.812644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293d3b1-816c-4a30-a984-20733d1dbd61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:19.813286 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d3b1-816c-4a30-a984-20733d1dbd61 service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.813578 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d3b1-816c-4a30-a984-20733d1dbd61 service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.813857 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d3b1-816c-4a30-a984-20733d1dbd61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.823800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293d3b1-816c-4a30-a984-20733d1dbd61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:19.825227 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293d3b1-816c-4a30-a984-20733d1dbd61 service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:19.825348 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4714a-b2e3-40a3-bc63-46b7974116bd None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:19.828791 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1b07f-b6e5-4471-aee5-191b6f791606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:19.829431 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1b07f-b6e5-4471-aee5-191b6f791606 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:19.829719 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1b07f-b6e5-4471-aee5-191b6f791606 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:19.829999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1b07f-b6e5-4471-aee5-191b6f791606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:19.835341 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 591/1175] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:36:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 16:36:19.839912 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1b07f-b6e5-4471-aee5-191b6f791606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:19.841339 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1b07f-b6e5-4471-aee5-191b6f791606 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:19.851764 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 585/1176] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:36:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:36:24.088812 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ef998-3a60-4151-bbe2-3c268267960b None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:24.089332 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ef998-3a60-4151-bbe2-3c268267960b None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:24.089424 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ef998-3a60-4151-bbe2-3c268267960b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:24.126930 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-b67ef998-3a60-4151-bbe2-3c268267960b None None] MFA Rules not processed for user `64a282a6605841719be67d7f6d2f90e0`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:24.132870 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-b67ef998-3a60-4151-bbe2-3c268267960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:24.261663 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 592/1177] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:36:24 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:24.262998 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1b07f-b6e5-4471-aee5-191b6f791606 service neutron] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:24.279085 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1b07f-b6e5-4471-aee5-191b6f791606 service neutron] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:24.288427 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4ef4b-ef1c-4fae-809e-62da7891bbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:24.289123 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4ef4b-ef1c-4fae-809e-62da7891bbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:24.289409 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4ef4b-ef1c-4fae-809e-62da7891bbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:24.289689 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4ef4b-ef1c-4fae-809e-62da7891bbb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:24.290440 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4ef4b-ef1c-4fae-809e-62da7891bbb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:24.298391 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4ef4b-ef1c-4fae-809e-62da7891bbb6 admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:24.352670 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 586/1178] 10.222.0.86 () {60 vars in 1152 bytes} [Fri Jul 15 16:36:24 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:36:24.356517 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ef998-3a60-4151-bbe2-3c268267960b None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:24.370253 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ef998-3a60-4151-bbe2-3c268267960b None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:24.480657 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d1a39-6118-49de-bd8d-ee78bbadc3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:24.481973 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d1a39-6118-49de-bd8d-ee78bbadc3bd admin admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:24.482497 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d1a39-6118-49de-bd8d-ee78bbadc3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:24.483072 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d1a39-6118-49de-bd8d-ee78bbadc3bd admin admin] PATH_INFO: `/v3/users` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:24.483998 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d1a39-6118-49de-bd8d-ee78bbadc3bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:24.486200 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d1a39-6118-49de-bd8d-ee78bbadc3bd admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:24.533922 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 593/1179] 10.222.0.86 () {60 vars in 1143 bytes} [Fri Jul 15 16:36:24 2022] POST /identity/v3/users => generated 296 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:36:24.535360 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4ef4b-ef1c-4fae-809e-62da7891bbb6 admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:24.548902 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4ef4b-ef1c-4fae-809e-62da7891bbb6 admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:24.571453 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35efbeb-76c7-4e02-bc20-3306d2f3fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:24.572152 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35efbeb-76c7-4e02-bc20-3306d2f3fc25 admin admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:24.572439 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35efbeb-76c7-4e02-bc20-3306d2f3fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:24.572719 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35efbeb-76c7-4e02-bc20-3306d2f3fc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:24.573461 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35efbeb-76c7-4e02-bc20-3306d2f3fc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:24.575124 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35efbeb-76c7-4e02-bc20-3306d2f3fc25 admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:24.598911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 587/1180] 10.222.0.86 () {58 vars in 1121 bytes} [Fri Jul 15 16:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 16:36:24.600711 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d1a39-6118-49de-bd8d-ee78bbadc3bd admin admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:24.629612 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d1a39-6118-49de-bd8d-ee78bbadc3bd admin admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:24.636120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8eb9c7-789a-4378-8d2a-ba791c5d1785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:24.637304 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8eb9c7-789a-4378-8d2a-ba791c5d1785 admin admin] REQUEST_METHOD: `PUT` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:24.637744 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8eb9c7-789a-4378-8d2a-ba791c5d1785 admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:24.638222 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8eb9c7-789a-4378-8d2a-ba791c5d1785 admin admin] PATH_INFO: `/v3/projects/f30f88d8dbc040f09eb29f264060eda9/users/c12192569cc1477e917dee9c6d92f207/roles/923dd61feaca45d0933a4601fb2c065b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:24.656685 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:36:24.705644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8eb9c7-789a-4378-8d2a-ba791c5d1785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30f88d8dbc040f09eb29f264060eda9, user_id=c12192569cc1477e917dee9c6d92f207, role_id=923dd61feaca45d0933a4601fb2c065b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:24.709582 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8eb9c7-789a-4378-8d2a-ba791c5d1785 admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:24.746396 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 594/1181] 10.222.0.86 () {60 vars in 1482 bytes} [Fri Jul 15 16:36:24 2022] PUT /identity/v3/projects/f30f88d8dbc040f09eb29f264060eda9/users/c12192569cc1477e917dee9c6d92f207/roles/923dd61feaca45d0933a4601fb2c065b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:36:24.750503 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35efbeb-76c7-4e02-bc20-3306d2f3fc25 admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:24.790710 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35efbeb-76c7-4e02-bc20-3306d2f3fc25 admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:24.892495 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb3786-3ca0-4456-90f8-28f21bd38bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:24.893420 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb3786-3ca0-4456-90f8-28f21bd38bcd admin admin] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:24.893775 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb3786-3ca0-4456-90f8-28f21bd38bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:24.894115 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb3786-3ca0-4456-90f8-28f21bd38bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:24.894859 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb3786-3ca0-4456-90f8-28f21bd38bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:24.896649 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb3786-3ca0-4456-90f8-28f21bd38bcd admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:24.915008 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8eb9c7-789a-4378-8d2a-ba791c5d1785 admin admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:24.917775 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 588/1182] 10.222.0.86 () {58 vars in 1121 bytes} [Fri Jul 15 16:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 16:36:24.933453 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8eb9c7-789a-4378-8d2a-ba791c5d1785 admin admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:24.948153 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393abe5c-be83-4dfe-9715-d62e8df4755f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:24.949078 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393abe5c-be83-4dfe-9715-d62e8df4755f admin admin] REQUEST_METHOD: `PUT` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:24.949367 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393abe5c-be83-4dfe-9715-d62e8df4755f admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:24.949643 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393abe5c-be83-4dfe-9715-d62e8df4755f admin admin] PATH_INFO: `/v3/projects/f30f88d8dbc040f09eb29f264060eda9/users/c12192569cc1477e917dee9c6d92f207/roles/923dd61feaca45d0933a4601fb2c065b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:24.952215 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393abe5c-be83-4dfe-9715-d62e8df4755f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30f88d8dbc040f09eb29f264060eda9, user_id=c12192569cc1477e917dee9c6d92f207, role_id=923dd61feaca45d0933a4601fb2c065b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:24.954941 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393abe5c-be83-4dfe-9715-d62e8df4755f admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:24.978818 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 595/1183] 10.222.0.86 () {60 vars in 1482 bytes} [Fri Jul 15 16:36:24 2022] PUT /identity/v3/projects/f30f88d8dbc040f09eb29f264060eda9/users/c12192569cc1477e917dee9c6d92f207/roles/923dd61feaca45d0933a4601fb2c065b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:36:25.944448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8589683-5b2b-4c2d-82fb-07e531de5d9c None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:25.945106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8589683-5b2b-4c2d-82fb-07e531de5d9c None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:25.945106 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8589683-5b2b-4c2d-82fb-07e531de5d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:25.977427 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-c8589683-5b2b-4c2d-82fb-07e531de5d9c None None] MFA Rules not processed for user `691785f55e1c485e8134b7f37d4a7172`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:25.978734 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-c8589683-5b2b-4c2d-82fb-07e531de5d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:26.015838 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:36:26.058503 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 589/1184] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:36:25 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:26.062965 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393abe5c-be83-4dfe-9715-d62e8df4755f admin admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:26.149472 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393abe5c-be83-4dfe-9715-d62e8df4755f admin admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:26.156283 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736ea03-c027-4e9d-b35c-56246d243994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:26.157507 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736ea03-c027-4e9d-b35c-56246d243994 admin admin] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:26.157968 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736ea03-c027-4e9d-b35c-56246d243994 admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:26.158708 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736ea03-c027-4e9d-b35c-56246d243994 admin admin] PATH_INFO: `/v3/projects` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:26.159674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736ea03-c027-4e9d-b35c-56246d243994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:26.163644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736ea03-c027-4e9d-b35c-56246d243994 admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:26.202647 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 596/1185] 10.222.0.86 () {60 vars in 1152 bytes} [Fri Jul 15 16:36:26 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:36:26.206314 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8589683-5b2b-4c2d-82fb-07e531de5d9c None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:26.222709 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8589683-5b2b-4c2d-82fb-07e531de5d9c None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:26.304434 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387472d-e945-41a1-824f-56bf6a5332a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:26.305233 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387472d-e945-41a1-824f-56bf6a5332a7 admin admin] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:26.305448 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387472d-e945-41a1-824f-56bf6a5332a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:26.305729 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387472d-e945-41a1-824f-56bf6a5332a7 admin admin] PATH_INFO: `/v3/users` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:26.306428 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387472d-e945-41a1-824f-56bf6a5332a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:26.308611 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387472d-e945-41a1-824f-56bf6a5332a7 admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:26.334348 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 590/1186] 10.222.0.86 () {60 vars in 1143 bytes} [Fri Jul 15 16:36:26 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 16:36:26.338348 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736ea03-c027-4e9d-b35c-56246d243994 admin admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:26.350324 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736ea03-c027-4e9d-b35c-56246d243994 admin admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:26.356915 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dc834-7b6b-40da-8acd-97311a9a81d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:26.357596 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dc834-7b6b-40da-8acd-97311a9a81d7 admin admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:26.358543 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dc834-7b6b-40da-8acd-97311a9a81d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:26.358929 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dc834-7b6b-40da-8acd-97311a9a81d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:26.359675 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dc834-7b6b-40da-8acd-97311a9a81d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:26.363501 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dc834-7b6b-40da-8acd-97311a9a81d7 admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:26.383839 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 597/1187] 10.222.0.86 () {58 vars in 1121 bytes} [Fri Jul 15 16:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 16:36:26.385421 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387472d-e945-41a1-824f-56bf6a5332a7 admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:26.397229 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387472d-e945-41a1-824f-56bf6a5332a7 admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:26.402947 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce9ecf-fea4-41ed-97bb-748a32131b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:26.404071 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce9ecf-fea4-41ed-97bb-748a32131b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:26.404519 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce9ecf-fea4-41ed-97bb-748a32131b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:26.405181 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce9ecf-fea4-41ed-97bb-748a32131b23 admin admin] PATH_INFO: `/v3/projects/75e5dc2692744bd1b76a11273f581f48/users/77459639497f48d8b8a17cc8c0f57003/roles/923dd61feaca45d0933a4601fb2c065b` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:26.428840 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce9ecf-fea4-41ed-97bb-748a32131b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e5dc2692744bd1b76a11273f581f48, user_id=77459639497f48d8b8a17cc8c0f57003, role_id=923dd61feaca45d0933a4601fb2c065b)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:26.432009 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce9ecf-fea4-41ed-97bb-748a32131b23 admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:26.475488 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dc834-7b6b-40da-8acd-97311a9a81d7 admin admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:26.485229 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 591/1188] 10.222.0.86 () {60 vars in 1482 bytes} [Fri Jul 15 16:36:26 2022] PUT /identity/v3/projects/75e5dc2692744bd1b76a11273f581f48/users/77459639497f48d8b8a17cc8c0f57003/roles/923dd61feaca45d0933a4601fb2c065b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:36:26.488165 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dc834-7b6b-40da-8acd-97311a9a81d7 admin admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:26.574324 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082a2fe-ec67-4b88-84b4-36cb46cd72dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:26.575159 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082a2fe-ec67-4b88-84b4-36cb46cd72dd admin admin] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:26.578608 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082a2fe-ec67-4b88-84b4-36cb46cd72dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:26.579039 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082a2fe-ec67-4b88-84b4-36cb46cd72dd admin admin] PATH_INFO: `/v3/roles` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:26.580237 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082a2fe-ec67-4b88-84b4-36cb46cd72dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:26.582397 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082a2fe-ec67-4b88-84b4-36cb46cd72dd admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:26.601301 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 598/1189] 10.222.0.86 () {58 vars in 1121 bytes} [Fri Jul 15 16:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 16:36:26.602525 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce9ecf-fea4-41ed-97bb-748a32131b23 admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:26.619572 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce9ecf-fea4-41ed-97bb-748a32131b23 admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:26.630967 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa724c-4a34-48e2-a927-899f01aaf0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:26.631937 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa724c-4a34-48e2-a927-899f01aaf0d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:26.632371 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa724c-4a34-48e2-a927-899f01aaf0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:26.632722 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa724c-4a34-48e2-a927-899f01aaf0d9 admin admin] PATH_INFO: `/v3/projects/75e5dc2692744bd1b76a11273f581f48/users/77459639497f48d8b8a17cc8c0f57003/roles/923dd61feaca45d0933a4601fb2c065b` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:26.635864 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa724c-4a34-48e2-a927-899f01aaf0d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e5dc2692744bd1b76a11273f581f48, user_id=77459639497f48d8b8a17cc8c0f57003, role_id=923dd61feaca45d0933a4601fb2c065b)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:26.639532 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa724c-4a34-48e2-a927-899f01aaf0d9 admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:26.675985 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 592/1190] 10.222.0.86 () {60 vars in 1482 bytes} [Fri Jul 15 16:36:26 2022] PUT /identity/v3/projects/75e5dc2692744bd1b76a11273f581f48/users/77459639497f48d8b8a17cc8c0f57003/roles/923dd61feaca45d0933a4601fb2c065b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:36:31.617187 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e32cd-234d-4d14-afb0-357bbd27852d None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:31.617187 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e32cd-234d-4d14-afb0-357bbd27852d None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:31.617837 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e32cd-234d-4d14-afb0-357bbd27852d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:31.656805 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-8d5e32cd-234d-4d14-afb0-357bbd27852d None None] MFA Rules not processed for user `c12192569cc1477e917dee9c6d92f207`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:31.658656 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-8d5e32cd-234d-4d14-afb0-357bbd27852d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:31.715790 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:36:31.788875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 599/1191] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:36:31 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:31.805918 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa724c-4a34-48e2-a927-899f01aaf0d9 admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:31.808127 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-03fa724c-4a34-48e2-a927-899f01aaf0d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:31.932420 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa724c-4a34-48e2-a927-899f01aaf0d9 admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:31.939460 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3014a-a672-4152-b4e3-8f2cb88cee1e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a518605222244f2974ab19a03e4cf93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:31.940294 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3014a-a672-4152-b4e3-8f2cb88cee1e service glance] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:31.940577 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3014a-a672-4152-b4e3-8f2cb88cee1e service glance] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:31.940858 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3014a-a672-4152-b4e3-8f2cb88cee1e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:31.989889 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:36:32.049739 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3014a-a672-4152-b4e3-8f2cb88cee1e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:32.051501 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3014a-a672-4152-b4e3-8f2cb88cee1e service glance] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:32.067288 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 593/1192] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:36:31 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:36:33.014233 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df58ff-3f46-4d3e-b7dd-df3730922c27 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:33.014783 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df58ff-3f46-4d3e-b7dd-df3730922c27 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:33.014899 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df58ff-3f46-4d3e-b7dd-df3730922c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:33.045084 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-f7df58ff-3f46-4d3e-b7dd-df3730922c27 None None] MFA Rules not processed for user `77459639497f48d8b8a17cc8c0f57003`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:33.046540 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-f7df58ff-3f46-4d3e-b7dd-df3730922c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:33.140950 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 600/1193] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:36:33 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:33.154795 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3014a-a672-4152-b4e3-8f2cb88cee1e service glance] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:33.165635 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3014a-a672-4152-b4e3-8f2cb88cee1e service glance] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:33.171047 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7fa6e-f9aa-4156-9ec5-67e78d25c5bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a518605222244f2974ab19a03e4cf93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:33.171720 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7fa6e-f9aa-4156-9ec5-67e78d25c5bb service glance] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:33.172160 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7fa6e-f9aa-4156-9ec5-67e78d25c5bb service glance] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:33.172454 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7fa6e-f9aa-4156-9ec5-67e78d25c5bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:33.242044 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7fa6e-f9aa-4156-9ec5-67e78d25c5bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:33.243471 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7fa6e-f9aa-4156-9ec5-67e78d25c5bb service glance] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:33.268277 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 594/1194] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:36:33 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:36:42.034982 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b82530-30e6-45e1-9305-cfacf05e443a None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:42.035538 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b82530-30e6-45e1-9305-cfacf05e443a None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:42.035538 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b82530-30e6-45e1-9305-cfacf05e443a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:42.128630 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-70b82530-30e6-45e1-9305-cfacf05e443a None None] MFA Rules not processed for user `691785f55e1c485e8134b7f37d4a7172`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:42.130068 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-70b82530-30e6-45e1-9305-cfacf05e443a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:42.174533 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 601/1195] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:36:42 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:42.514771 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaab9a-3525-40f8-8a16-99ffd6ca95ec None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:42.515736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaab9a-3525-40f8-8a16-99ffd6ca95ec None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:42.516023 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaab9a-3525-40f8-8a16-99ffd6ca95ec None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:42.517508 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 595/1196] 10.222.0.86 () {54 vars in 961 bytes} [Fri Jul 15 16:36:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:36:42.523648 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092caf56-8128-43ca-a348-c369908e251a None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:42.524193 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092caf56-8128-43ca-a348-c369908e251a None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:42.524685 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092caf56-8128-43ca-a348-c369908e251a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:42.560409 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-092caf56-8128-43ca-a348-c369908e251a None None] MFA Rules not processed for user `f34916bd4d56411e8994d1c476885e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:42.561875 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-092caf56-8128-43ca-a348-c369908e251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:42.643767 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 602/1197] 10.222.0.86 () {58 vars in 1058 bytes} [Fri Jul 15 16:36:42 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:42.650179 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe839f0-9bb2-4b33-bf80-cc06ed696fe9 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:42.650558 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe839f0-9bb2-4b33-bf80-cc06ed696fe9 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:42.650851 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe839f0-9bb2-4b33-bf80-cc06ed696fe9 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:42.652531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 596/1198] 10.222.0.86 () {54 vars in 912 bytes} [Fri Jul 15 16:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:36:42.658185 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088421d-be52-4205-b72f-9ad6c896701b None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:42.658673 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088421d-be52-4205-b72f-9ad6c896701b None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:42.659007 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088421d-be52-4205-b72f-9ad6c896701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:42.679990 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-2088421d-be52-4205-b72f-9ad6c896701b None None] MFA Rules not processed for user `f34916bd4d56411e8994d1c476885e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:42.682337 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-2088421d-be52-4205-b72f-9ad6c896701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:42.701217 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 603/1199] 10.222.0.86 () {58 vars in 1009 bytes} [Fri Jul 15 16:36:42 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:42.709315 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe839f0-9bb2-4b33-bf80-cc06ed696fe9 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:42.711321 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-3fe839f0-9bb2-4b33-bf80-cc06ed696fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:42.731230 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe839f0-9bb2-4b33-bf80-cc06ed696fe9 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:42.735494 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ad534-7e63-4a47-8bfd-9a27dcb44645 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a518605222244f2974ab19a03e4cf93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:42.736261 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ad534-7e63-4a47-8bfd-9a27dcb44645 service glance] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:42.736757 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ad534-7e63-4a47-8bfd-9a27dcb44645 service glance] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:42.737140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ad534-7e63-4a47-8bfd-9a27dcb44645 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:42.749521 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ad534-7e63-4a47-8bfd-9a27dcb44645 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:42.752911 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ad534-7e63-4a47-8bfd-9a27dcb44645 service glance] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:42.765316 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 597/1200] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:36:42 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:36:43.109804 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a769ca6-f6d7-4c4b-a1d5-6c1f89f6d9b7 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:43.110343 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a769ca6-f6d7-4c4b-a1d5-6c1f89f6d9b7 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:43.110343 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a769ca6-f6d7-4c4b-a1d5-6c1f89f6d9b7 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:43.111957 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 604/1201] 10.222.0.86 () {54 vars in 912 bytes} [Fri Jul 15 16:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:36:43.116988 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea046de-a815-450e-8d24-8a2e5bcf25de None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:43.117282 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea046de-a815-450e-8d24-8a2e5bcf25de None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:43.117562 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea046de-a815-450e-8d24-8a2e5bcf25de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:43.146157 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-3ea046de-a815-450e-8d24-8a2e5bcf25de None None] MFA Rules not processed for user `8e620f2a895241279b63327d6a7d3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:43.147331 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-3ea046de-a815-450e-8d24-8a2e5bcf25de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:43.213139 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 598/1202] 10.222.0.86 () {58 vars in 1009 bytes} [Fri Jul 15 16:36:43 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:43.224651 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a769ca6-f6d7-4c4b-a1d5-6c1f89f6d9b7 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:43.236033 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a769ca6-f6d7-4c4b-a1d5-6c1f89f6d9b7 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:43.240015 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d825c7f-b7f5-48c2-a5fd-f5943ecff779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:43.240730 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d825c7f-b7f5-48c2-a5fd-f5943ecff779 service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:43.241036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d825c7f-b7f5-48c2-a5fd-f5943ecff779 service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:43.241310 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d825c7f-b7f5-48c2-a5fd-f5943ecff779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:43.249097 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d825c7f-b7f5-48c2-a5fd-f5943ecff779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:43.250610 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d825c7f-b7f5-48c2-a5fd-f5943ecff779 service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:43.259133 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 605/1203] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:36:43 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 16:36:43.654231 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a1d05-17ab-48ff-97b4-13f951422f30 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:43.654812 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a1d05-17ab-48ff-97b4-13f951422f30 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:43.654812 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a1d05-17ab-48ff-97b4-13f951422f30 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:43.656425 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 599/1204] 10.222.0.86 () {54 vars in 961 bytes} [Fri Jul 15 16:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:36:43.662792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b011ed9-612b-4109-b649-94d250c8508f None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:43.662792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b011ed9-612b-4109-b649-94d250c8508f None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:43.662792 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b011ed9-612b-4109-b649-94d250c8508f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:43.682261 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-2b011ed9-612b-4109-b649-94d250c8508f None None] MFA Rules not processed for user `f34916bd4d56411e8994d1c476885e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:43.683698 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-2b011ed9-612b-4109-b649-94d250c8508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:43.688220 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dfef4-d676-4b07-b15a-f2f25ad9a59e None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:43.688580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dfef4-d676-4b07-b15a-f2f25ad9a59e None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:43.688925 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dfef4-d676-4b07-b15a-f2f25ad9a59e None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:43.690353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 600/1205] 10.222.0.86 () {54 vars in 960 bytes} [Fri Jul 15 16:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:36:43.692779 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 606/1206] 10.222.0.86 () {58 vars in 1058 bytes} [Fri Jul 15 16:36:43 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:43.697647 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cace025-400a-4289-91fc-d48a5356c4e3 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:43.697999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cace025-400a-4289-91fc-d48a5356c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:43.698343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cace025-400a-4289-91fc-d48a5356c4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:43.701473 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79014d1d-e71f-4fe8-84a3-06ea38a09591 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:43.701761 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79014d1d-e71f-4fe8-84a3-06ea38a09591 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:43.702034 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79014d1d-e71f-4fe8-84a3-06ea38a09591 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:43.703487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 607/1207] 10.222.0.86 () {54 vars in 912 bytes} [Fri Jul 15 16:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:36:43.709005 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0914146-c369-447a-ae35-a409661c42ba None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:43.709300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0914146-c369-447a-ae35-a409661c42ba None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:43.709568 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0914146-c369-447a-ae35-a409661c42ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:43.716834 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:36:43.717657 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-6cace025-400a-4289-91fc-d48a5356c4e3 None None] MFA Rules not processed for user `f716b4b39b3d4547ab937f5a5ffccf08`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:43.719415 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-6cace025-400a-4289-91fc-d48a5356c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:43.728644 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-d0914146-c369-447a-ae35-a409661c42ba None None] MFA Rules not processed for user `f34916bd4d56411e8994d1c476885e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:43.730016 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-d0914146-c369-447a-ae35-a409661c42ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:43.747026 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 608/1208] 10.222.0.86 () {58 vars in 1009 bytes} [Fri Jul 15 16:36:43 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:43.757118 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0914146-c369-447a-ae35-a409661c42ba None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:43.766548 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0914146-c369-447a-ae35-a409661c42ba None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:43.770360 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63f97d-2a1b-4958-97bb-1c26aa2814af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:43.770970 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63f97d-2a1b-4958-97bb-1c26aa2814af service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:43.771291 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63f97d-2a1b-4958-97bb-1c26aa2814af service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:43.771567 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63f97d-2a1b-4958-97bb-1c26aa2814af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:43.781882 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63f97d-2a1b-4958-97bb-1c26aa2814af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:43.783922 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63f97d-2a1b-4958-97bb-1c26aa2814af service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:43.785074 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=100 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:36:43.798631 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 609/1209] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:36:43 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:36:43.804256 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 601/1210] 10.222.0.86 () {58 vars in 1057 bytes} [Fri Jul 15 16:36:43 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 16:36:43.812224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63f97d-2a1b-4958-97bb-1c26aa2814af service neutron] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:43.824132 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63f97d-2a1b-4958-97bb-1c26aa2814af service neutron] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:43.829389 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def8ac6-0cb3-4d04-8774-be9c3fdfa85f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f716b4b39b3d4547ab937f5a5ffccf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:43.830040 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def8ac6-0cb3-4d04-8774-be9c3fdfa85f service placement] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:43.830325 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def8ac6-0cb3-4d04-8774-be9c3fdfa85f service placement] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:43.830606 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def8ac6-0cb3-4d04-8774-be9c3fdfa85f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:43.832460 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-2def8ac6-0cb3-4d04-8774-be9c3fdfa85f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:43.844702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def8ac6-0cb3-4d04-8774-be9c3fdfa85f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:43.846280 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def8ac6-0cb3-4d04-8774-be9c3fdfa85f service placement] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:43.858702 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 610/1211] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:36:43 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:36:53.796505 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:36:53.853737 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=13 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:36:54.856301 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d98488-869b-42f8-9eb0-ecc32ac55286 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:54.856853 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d98488-869b-42f8-9eb0-ecc32ac55286 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:54.856947 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d98488-869b-42f8-9eb0-ecc32ac55286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:54.876005 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-f4d98488-869b-42f8-9eb0-ecc32ac55286 None None] MFA Rules not processed for user `8e620f2a895241279b63327d6a7d3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:54.877184 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-f4d98488-869b-42f8-9eb0-ecc32ac55286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:54.884523 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 602/1212] 10.222.0.96 () {58 vars in 1015 bytes} [Fri Jul 15 16:36:54 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:54.897780 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def8ac6-0cb3-4d04-8774-be9c3fdfa85f service placement] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:54.912584 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def8ac6-0cb3-4d04-8774-be9c3fdfa85f service placement] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:54.915748 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ae82d-cdc2-480c-81b9-217530c72fd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:54.916495 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ae82d-cdc2-480c-81b9-217530c72fd2 service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:54.916729 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ae82d-cdc2-480c-81b9-217530c72fd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:54.917211 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ae82d-cdc2-480c-81b9-217530c72fd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:54.924879 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ae82d-cdc2-480c-81b9-217530c72fd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:54.926300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ae82d-cdc2-480c-81b9-217530c72fd2 service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:54.934799 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 611/1213] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:36:54 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:36:55.677232 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380d7f5-501c-4b9b-b185-903a3f42dd82 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:55.677944 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380d7f5-501c-4b9b-b185-903a3f42dd82 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:55.678456 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380d7f5-501c-4b9b-b185-903a3f42dd82 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:55.682756 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 603/1214] 10.222.0.86 () {54 vars in 921 bytes} [Fri Jul 15 16:36:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:36:55.713912 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17354ec-a701-4bc3-ad95-3a1ce2256457 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:55.714425 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17354ec-a701-4bc3-ad95-3a1ce2256457 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:55.714982 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17354ec-a701-4bc3-ad95-3a1ce2256457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:55.738664 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-c17354ec-a701-4bc3-ad95-3a1ce2256457 None None] MFA Rules not processed for user `f34916bd4d56411e8994d1c476885e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:36:55.740364 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-c17354ec-a701-4bc3-ad95-3a1ce2256457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:36:55.752763 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 612/1215] 10.222.0.86 () {58 vars in 1018 bytes} [Fri Jul 15 16:36:55 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:36:55.775168 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380d7f5-501c-4b9b-b185-903a3f42dd82 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:36:55.792648 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380d7f5-501c-4b9b-b185-903a3f42dd82 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:36:55.803387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234dcdd-cd88-41c4-8299-9f73f60ce087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:36:55.804306 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234dcdd-cd88-41c4-8299-9f73f60ce087 service nova] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:36:55.804580 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234dcdd-cd88-41c4-8299-9f73f60ce087 service nova] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:36:55.804859 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234dcdd-cd88-41c4-8299-9f73f60ce087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:36:55.817052 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234dcdd-cd88-41c4-8299-9f73f60ce087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:36:55.820122 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234dcdd-cd88-41c4-8299-9f73f60ce087 service nova] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:36:55.835455 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 604/1216] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:36:55 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:37:02.227620 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4a288-02b2-4dd9-a13f-7884a1a4f120 None None] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:37:02.228248 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4a288-02b2-4dd9-a13f-7884a1a4f120 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:37:02.228248 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4a288-02b2-4dd9-a13f-7884a1a4f120 None None] PATH_INFO: `/` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:37:02.230105 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 613/1217] 10.222.0.86 () {54 vars in 921 bytes} [Fri Jul 15 16:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:37:02.241024 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8113-fe8b-4f7e-afcc-5d1f5357186e None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:37:02.241534 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8113-fe8b-4f7e-afcc-5d1f5357186e None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:37:02.241786 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8113-fe8b-4f7e-afcc-5d1f5357186e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:37:02.262905 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-e0ff8113-fe8b-4f7e-afcc-5d1f5357186e None None] MFA Rules not processed for user `f34916bd4d56411e8994d1c476885e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:37:02.264403 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-e0ff8113-fe8b-4f7e-afcc-5d1f5357186e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:37:02.274058 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 605/1218] 10.222.0.86 () {58 vars in 1018 bytes} [Fri Jul 15 16:37:02 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 16:37:02.288174 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4a288-02b2-4dd9-a13f-7884a1a4f120 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:37:02.306351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4a288-02b2-4dd9-a13f-7884a1a4f120 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:37:02.312328 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8ec79-93a5-4962-be9d-c42b3bcc8523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:37:02.312969 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8ec79-93a5-4962-be9d-c42b3bcc8523 service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:37:02.313436 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8ec79-93a5-4962-be9d-c42b3bcc8523 service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:37:02.313760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8ec79-93a5-4962-be9d-c42b3bcc8523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:37:02.323648 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8ec79-93a5-4962-be9d-c42b3bcc8523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:37:02.325447 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8ec79-93a5-4962-be9d-c42b3bcc8523 service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:37:02.335473 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 614/1219] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:37:02 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:37:12.257591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=12 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:37:12.331174 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=15 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:37:14.853161 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff8113-fe8b-4f7e-afcc-5d1f5357186e None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:37:14.862703 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff8113-fe8b-4f7e-afcc-5d1f5357186e None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:37:14.866603 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54563e0-f8f8-4b8d-9cf7-b6ac47c6551c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:37:14.867295 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54563e0-f8f8-4b8d-9cf7-b6ac47c6551c service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:37:14.867578 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54563e0-f8f8-4b8d-9cf7-b6ac47c6551c service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:37:14.867853 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54563e0-f8f8-4b8d-9cf7-b6ac47c6551c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:37:14.877950 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54563e0-f8f8-4b8d-9cf7-b6ac47c6551c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:37:14.878483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54563e0-f8f8-4b8d-9cf7-b6ac47c6551c service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:37:14.887829 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 606/1220] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:37:14 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:37:24.883736 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=6 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:37:29.871128 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f15bc-18dc-4d8b-92c9-6172dd1a04b0 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:37:29.871701 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f15bc-18dc-4d8b-92c9-6172dd1a04b0 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:37:29.871800 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f15bc-18dc-4d8b-92c9-6172dd1a04b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:37:29.888592 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-b77f15bc-18dc-4d8b-92c9-6172dd1a04b0 None None] MFA Rules not processed for user `64a282a6605841719be67d7f6d2f90e0`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:37:29.889805 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-b77f15bc-18dc-4d8b-92c9-6172dd1a04b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:37:29.897342 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 615/1221] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:37:29 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:37:30.185310 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f963b6b-8870-42fd-84b9-ca1623e6cf34 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:37:30.185799 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f963b6b-8870-42fd-84b9-ca1623e6cf34 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:37:30.185910 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f963b6b-8870-42fd-84b9-ca1623e6cf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:37:30.204165 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-3f963b6b-8870-42fd-84b9-ca1623e6cf34 None None] MFA Rules not processed for user `8e620f2a895241279b63327d6a7d3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:37:30.205335 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-3f963b6b-8870-42fd-84b9-ca1623e6cf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:37:30.212267 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 607/1222] 10.222.0.86 () {58 vars in 1009 bytes} [Fri Jul 15 16:37:30 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:37:30.225564 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f15bc-18dc-4d8b-92c9-6172dd1a04b0 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:37:30.234815 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f15bc-18dc-4d8b-92c9-6172dd1a04b0 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:37:30.238249 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740c366-b2e1-4338-9f89-50637763ffd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:37:30.238896 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740c366-b2e1-4338-9f89-50637763ffd6 service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:37:30.239186 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740c366-b2e1-4338-9f89-50637763ffd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:37:30.239463 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740c366-b2e1-4338-9f89-50637763ffd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:37:30.246389 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740c366-b2e1-4338-9f89-50637763ffd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:37:30.247829 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740c366-b2e1-4338-9f89-50637763ffd6 service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:37:30.255398 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 616/1223] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:37:30 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:37:40.199137 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=3 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:37:40.252055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=9 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:37:55.306472 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4f1ba-6ef8-47ef-af7f-ec991fdafbf0 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:37:55.307012 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4f1ba-6ef8-47ef-af7f-ec991fdafbf0 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:37:55.307161 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4f1ba-6ef8-47ef-af7f-ec991fdafbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:37:55.325263 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-24c4f1ba-6ef8-47ef-af7f-ec991fdafbf0 None None] MFA Rules not processed for user `64a282a6605841719be67d7f6d2f90e0`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:37:55.326457 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-24c4f1ba-6ef8-47ef-af7f-ec991fdafbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:37:55.333598 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 608/1224] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:37:55 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:38:05.320061 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=3 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:38:09.895963 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8d589-4bba-421b-a99e-ed1754d48c2f None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:38:09.896421 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8d589-4bba-421b-a99e-ed1754d48c2f None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:38:09.896508 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8d589-4bba-421b-a99e-ed1754d48c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:38:09.914462 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-37a8d589-4bba-421b-a99e-ed1754d48c2f None None] MFA Rules not processed for user `64a282a6605841719be67d7f6d2f90e0`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:38:09.915692 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-37a8d589-4bba-421b-a99e-ed1754d48c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:38:09.922431 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 617/1225] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:38:09 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:38:19.908660 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=3 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:39:08.670023 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf340b-3722-45bf-9171-51a61ca8bd6f None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:39:08.670526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf340b-3722-45bf-9171-51a61ca8bd6f None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:39:08.670621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf340b-3722-45bf-9171-51a61ca8bd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:39:08.688140 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-0cdf340b-3722-45bf-9171-51a61ca8bd6f None None] MFA Rules not processed for user `64a282a6605841719be67d7f6d2f90e0`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:39:08.690130 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-0cdf340b-3722-45bf-9171-51a61ca8bd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:39:08.696905 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 609/1226] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:39:08 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:39:18.683231 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=3 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:39:21.542452 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8d589-4bba-421b-a99e-ed1754d48c2f None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:39:21.561440 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8d589-4bba-421b-a99e-ed1754d48c2f None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:39:21.566034 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bce54-7af9-455a-be6d-cf3cdef7e0ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:39:21.566676 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bce54-7af9-455a-be6d-cf3cdef7e0ca service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:39:21.566999 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bce54-7af9-455a-be6d-cf3cdef7e0ca service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:39:21.567282 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bce54-7af9-455a-be6d-cf3cdef7e0ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:39:21.576163 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bce54-7af9-455a-be6d-cf3cdef7e0ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:39:21.577583 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bce54-7af9-455a-be6d-cf3cdef7e0ca service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:39:21.586884 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 618/1227] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:39:21 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:39:31.582801 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=10 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:39:48.468126 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf340b-3722-45bf-9171-51a61ca8bd6f None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:39:48.498251 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf340b-3722-45bf-9171-51a61ca8bd6f None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:39:48.503323 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4a46e-b4e9-4290-986a-205fb15f38c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f716b4b39b3d4547ab937f5a5ffccf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:39:48.504004 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4a46e-b4e9-4290-986a-205fb15f38c8 service placement] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:39:48.504292 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4a46e-b4e9-4290-986a-205fb15f38c8 service placement] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:39:48.504579 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4a46e-b4e9-4290-986a-205fb15f38c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:39:48.514573 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4a46e-b4e9-4290-986a-205fb15f38c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:39:48.516635 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4a46e-b4e9-4290-986a-205fb15f38c8 service placement] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:39:48.530013 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 610/1228] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:39:48 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:39:58.524065 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=10 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:41:36.229383 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bce54-7af9-455a-be6d-cf3cdef7e0ca service neutron] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:41:36.249158 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bce54-7af9-455a-be6d-cf3cdef7e0ca service neutron] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:41:36.254478 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb449e2-44cf-44f8-94d3-320c6c6fbf2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:41:36.255131 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb449e2-44cf-44f8-94d3-320c6c6fbf2b service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:41:36.255413 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb449e2-44cf-44f8-94d3-320c6c6fbf2b service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:41:36.255685 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb449e2-44cf-44f8-94d3-320c6c6fbf2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:41:36.263223 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb449e2-44cf-44f8-94d3-320c6c6fbf2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:41:36.264842 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb449e2-44cf-44f8-94d3-320c6c6fbf2b service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:41:36.274083 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 619/1229] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:41:36 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:41:36.332893 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65671c-2e45-43cb-9263-fea2d936e890 None None] REQUEST_METHOD: `POST` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:41:36.333373 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65671c-2e45-43cb-9263-fea2d936e890 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:41:36.333470 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65671c-2e45-43cb-9263-fea2d936e890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:41:36.350842 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.auth.core [None req-0a65671c-2e45-43cb-9263-fea2d936e890 None None] MFA Rules not processed for user `691785f55e1c485e8134b7f37d4a7172`. Rule list: `[]` (Enabled: `True`). {{(pid=87100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:41:36.352071 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-0a65671c-2e45-43cb-9263-fea2d936e890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:41:36.358791 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 611/1230] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:41:36 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:41:40.273895 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb449e2-44cf-44f8-94d3-320c6c6fbf2b service nova] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:41:40.285039 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb449e2-44cf-44f8-94d3-320c6c6fbf2b service nova] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:41:40.291142 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726e73e-0d03-4df4-9f0c-3c3b1a833418 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:41:40.292050 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726e73e-0d03-4df4-9f0c-3c3b1a833418 service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:41:40.292197 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726e73e-0d03-4df4-9f0c-3c3b1a833418 service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:41:40.292543 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726e73e-0d03-4df4-9f0c-3c3b1a833418 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:41:40.301120 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726e73e-0d03-4df4-9f0c-3c3b1a833418 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:41:40.302817 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726e73e-0d03-4df4-9f0c-3c3b1a833418 service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:41:40.312322 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 620/1231] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:41:40 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:41:42.832512 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65671c-2e45-43cb-9263-fea2d936e890 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:41:42.842769 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65671c-2e45-43cb-9263-fea2d936e890 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:41:42.846247 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516136d9-1fe0-42eb-a043-8b90fe5f50a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:41:42.846917 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516136d9-1fe0-42eb-a043-8b90fe5f50a2 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:41:42.847208 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516136d9-1fe0-42eb-a043-8b90fe5f50a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:41:42.847487 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516136d9-1fe0-42eb-a043-8b90fe5f50a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:41:42.856971 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516136d9-1fe0-42eb-a043-8b90fe5f50a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:41:42.858558 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516136d9-1fe0-42eb-a043-8b90fe5f50a2 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:41:42.869665 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 612/1232] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:41:42 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:41:43.799656 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726e73e-0d03-4df4-9f0c-3c3b1a833418 service nova] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:41:43.810130 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726e73e-0d03-4df4-9f0c-3c3b1a833418 service nova] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:41:43.813968 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f3a37-ae70-4f5d-81b5-1f53316ce103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:41:43.814645 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f3a37-ae70-4f5d-81b5-1f53316ce103 service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:41:43.814966 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f3a37-ae70-4f5d-81b5-1f53316ce103 service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:41:43.815251 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f3a37-ae70-4f5d-81b5-1f53316ce103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:41:43.825714 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f3a37-ae70-4f5d-81b5-1f53316ce103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:41:43.827413 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f3a37-ae70-4f5d-81b5-1f53316ce103 service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:41:43.838484 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 621/1233] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:41:43 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:41:49.304818 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dded2-b077-4356-9e33-b07e49392ab9 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:41:49.305672 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dded2-b077-4356-9e33-b07e49392ab9 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:41:49.306134 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dded2-b077-4356-9e33-b07e49392ab9 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:41:49.307930 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 613/1234] 10.222.0.86 () {54 vars in 921 bytes} [Fri Jul 15 16:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:41:49.313652 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a475b-a562-40dd-b80b-09519bad3a41 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:41:49.314210 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a475b-a562-40dd-b80b-09519bad3a41 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:41:49.314210 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a475b-a562-40dd-b80b-09519bad3a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:41:49.386681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-be7a475b-a562-40dd-b80b-09519bad3a41 None None] MFA Rules not processed for user `f34916bd4d56411e8994d1c476885e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:41:49.388654 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-be7a475b-a562-40dd-b80b-09519bad3a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:41:49.409178 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 622/1235] 10.222.0.86 () {58 vars in 1018 bytes} [Fri Jul 15 16:41:49 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:41:49.417509 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dded2-b077-4356-9e33-b07e49392ab9 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:41:49.436505 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dded2-b077-4356-9e33-b07e49392ab9 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:41:49.442951 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97309348-d302-434e-801d-ad0e21af63c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:41:49.444003 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309348-d302-434e-801d-ad0e21af63c1 service nova] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:41:49.445245 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309348-d302-434e-801d-ad0e21af63c1 service nova] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:41:49.445706 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309348-d302-434e-801d-ad0e21af63c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:41:49.456070 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97309348-d302-434e-801d-ad0e21af63c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:41:49.458029 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97309348-d302-434e-801d-ad0e21af63c1 service nova] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:41:49.479749 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 614/1236] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:41:49 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:41:51.132796 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d269591-0ef9-4dc1-9e04-a7c43a4028ac None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:41:51.133281 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d269591-0ef9-4dc1-9e04-a7c43a4028ac None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:41:51.133370 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d269591-0ef9-4dc1-9e04-a7c43a4028ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:41:51.151055 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-7d269591-0ef9-4dc1-9e04-a7c43a4028ac None None] MFA Rules not processed for user `64a282a6605841719be67d7f6d2f90e0`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:41:51.152267 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-7d269591-0ef9-4dc1-9e04-a7c43a4028ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:41:51.159375 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 623/1237] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:41:51 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:41:51.469728 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97309348-d302-434e-801d-ad0e21af63c1 service nova] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:41:51.478892 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97309348-d302-434e-801d-ad0e21af63c1 service nova] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:41:51.482401 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339193db-63c9-4e37-a344-52a4eab2ffa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:41:51.483157 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339193db-63c9-4e37-a344-52a4eab2ffa5 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:41:51.483659 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339193db-63c9-4e37-a344-52a4eab2ffa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:41:51.484034 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339193db-63c9-4e37-a344-52a4eab2ffa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:41:51.491695 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339193db-63c9-4e37-a344-52a4eab2ffa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:41:51.493124 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339193db-63c9-4e37-a344-52a4eab2ffa5 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:41:51.501431 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 615/1238] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:41:51 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:41:51.967284 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d269591-0ef9-4dc1-9e04-a7c43a4028ac None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:41:51.982972 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d269591-0ef9-4dc1-9e04-a7c43a4028ac None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:41:51.990058 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf58eca-fc02-479b-a44d-6a32977b5dfe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f716b4b39b3d4547ab937f5a5ffccf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:41:51.990795 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf58eca-fc02-479b-a44d-6a32977b5dfe service placement] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:41:51.991681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf58eca-fc02-479b-a44d-6a32977b5dfe service placement] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:41:51.992254 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf58eca-fc02-479b-a44d-6a32977b5dfe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:41:52.002367 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf58eca-fc02-479b-a44d-6a32977b5dfe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:41:52.004045 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf58eca-fc02-479b-a44d-6a32977b5dfe service placement] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:41:52.021407 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 624/1239] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:41:51 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:41:54.894974 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339193db-63c9-4e37-a344-52a4eab2ffa5 service neutron] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:41:54.904357 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339193db-63c9-4e37-a344-52a4eab2ffa5 service neutron] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:41:54.908115 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27924c-4243-4506-843d-e87e4d5e1dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:41:54.908842 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27924c-4243-4506-843d-e87e4d5e1dbe service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:41:54.909248 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27924c-4243-4506-843d-e87e4d5e1dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:41:54.909741 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27924c-4243-4506-843d-e87e4d5e1dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:41:54.917790 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27924c-4243-4506-843d-e87e4d5e1dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:41:54.919358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27924c-4243-4506-843d-e87e4d5e1dbe service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:41:54.927835 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 616/1240] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:41:54 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:42:01.663227 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf58eca-fc02-479b-a44d-6a32977b5dfe service placement] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:42:01.669366 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=45 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:42:01.680791 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf58eca-fc02-479b-a44d-6a32977b5dfe service placement] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:42:01.686195 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a4768-410f-43bc-a9f5-90f046fec6cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:42:01.686837 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a4768-410f-43bc-a9f5-90f046fec6cc service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:42:01.687158 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a4768-410f-43bc-a9f5-90f046fec6cc service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:42:01.687435 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a4768-410f-43bc-a9f5-90f046fec6cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:42:01.696734 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a4768-410f-43bc-a9f5-90f046fec6cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:42:01.698239 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a4768-410f-43bc-a9f5-90f046fec6cc service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:42:01.707858 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 625/1241] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:42:01 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:42:04.924115 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=27 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:42:06.295721 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27924c-4243-4506-843d-e87e4d5e1dbe service neutron] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:42:06.312235 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27924c-4243-4506-843d-e87e4d5e1dbe service neutron] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:42:06.318081 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ac9e2-6aac-4d1d-a84c-80e153c61cf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:42:06.318849 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac9e2-6aac-4d1d-a84c-80e153c61cf1 service nova] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:42:06.319257 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac9e2-6aac-4d1d-a84c-80e153c61cf1 service nova] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:42:06.319605 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac9e2-6aac-4d1d-a84c-80e153c61cf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:42:06.329609 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ac9e2-6aac-4d1d-a84c-80e153c61cf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:42:06.331329 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ac9e2-6aac-4d1d-a84c-80e153c61cf1 service nova] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:42:06.341782 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 617/1242] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:42:06 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:42:11.703930 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=5 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:42:16.337444 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=6 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:43:45.236659 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a4768-410f-43bc-a9f5-90f046fec6cc service nova] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:43:45.245679 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a4768-410f-43bc-a9f5-90f046fec6cc service nova] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:43:45.249845 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025a06a-2823-4682-9ca5-ff3453b545f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:43:45.250477 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025a06a-2823-4682-9ca5-ff3453b545f5 service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:43:45.250761 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025a06a-2823-4682-9ca5-ff3453b545f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:43:45.251067 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025a06a-2823-4682-9ca5-ff3453b545f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:43:45.310311 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025a06a-2823-4682-9ca5-ff3453b545f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:43:45.311756 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025a06a-2823-4682-9ca5-ff3453b545f5 service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:43:45.329478 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 626/1243] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:43:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:43:48.554274 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b6ed-6623-432a-844b-1b81cc177500 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:43:48.554908 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b6ed-6623-432a-844b-1b81cc177500 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:43:48.555103 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b6ed-6623-432a-844b-1b81cc177500 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:43:48.556805 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 618/1244] 10.222.0.86 () {54 vars in 921 bytes} [Fri Jul 15 16:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:43:48.564711 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec3510-1ad3-44c5-a9d9-74e5024bb2d6 None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:43:48.565204 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec3510-1ad3-44c5-a9d9-74e5024bb2d6 None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:43:48.565312 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec3510-1ad3-44c5-a9d9-74e5024bb2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:43:48.623459 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-37ec3510-1ad3-44c5-a9d9-74e5024bb2d6 None None] MFA Rules not processed for user `f716b4b39b3d4547ab937f5a5ffccf08`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:43:48.624761 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-37ec3510-1ad3-44c5-a9d9-74e5024bb2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:43:48.634021 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 627/1245] 10.222.0.86 () {58 vars in 1018 bytes} [Fri Jul 15 16:43:48 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:43:48.649083 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798b6ed-6623-432a-844b-1b81cc177500 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:43:48.662553 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798b6ed-6623-432a-844b-1b81cc177500 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:43:48.668467 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d349505-479f-4838-a543-6ab1d4b43494 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f716b4b39b3d4547ab937f5a5ffccf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:43:48.669101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d349505-479f-4838-a543-6ab1d4b43494 service placement] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:43:48.669379 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d349505-479f-4838-a543-6ab1d4b43494 service placement] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:43:48.669648 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d349505-479f-4838-a543-6ab1d4b43494 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:43:48.678041 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d349505-479f-4838-a543-6ab1d4b43494 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:43:48.679701 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d349505-479f-4838-a543-6ab1d4b43494 service placement] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:43:48.690358 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 619/1246] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:43:48 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:43:51.772240 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec3510-1ad3-44c5-a9d9-74e5024bb2d6 None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:43:51.784473 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec3510-1ad3-44c5-a9d9-74e5024bb2d6 None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:43:51.790351 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e160df5-be69-462b-a8f7-a40ce9b031a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:43:51.791192 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e160df5-be69-462b-a8f7-a40ce9b031a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:43:51.791480 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e160df5-be69-462b-a8f7-a40ce9b031a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:43:51.791762 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e160df5-be69-462b-a8f7-a40ce9b031a7 admin admin] PATH_INFO: `/v3/users/691785f55e1c485e8134b7f37d4a7172` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:43:51.793020 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e160df5-be69-462b-a8f7-a40ce9b031a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=691785f55e1c485e8134b7f37d4a7172)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:43:51.795036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e160df5-be69-462b-a8f7-a40ce9b031a7 admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:43:51.850835 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-5e160df5-be69-462b-a8f7-a40ce9b031a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '691785f55e1c485e8134b7f37d4a7172'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:51.864686 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-5e160df5-be69-462b-a8f7-a40ce9b031a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '691785f55e1c485e8134b7f37d4a7172'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:51.865859 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-5e160df5-be69-462b-a8f7-a40ce9b031a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '691785f55e1c485e8134b7f37d4a7172'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:51.879890 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-5e160df5-be69-462b-a8f7-a40ce9b031a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '691785f55e1c485e8134b7f37d4a7172'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:51.892479 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-5e160df5-be69-462b-a8f7-a40ce9b031a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '691785f55e1c485e8134b7f37d4a7172'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:51.898487 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 628/1247] 10.222.0.86 () {58 vars in 1223 bytes} [Fri Jul 15 16:43:51 2022] DELETE /identity/v3/users/691785f55e1c485e8134b7f37d4a7172 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:43:52.080754 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d349505-479f-4838-a543-6ab1d4b43494 service placement] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:43:52.094186 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d349505-479f-4838-a543-6ab1d4b43494 service placement] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:43:52.156235 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf7004-53e4-4b70-925f-2998373e83dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:43:52.157114 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf7004-53e4-4b70-925f-2998373e83dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:43:52.157400 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf7004-53e4-4b70-925f-2998373e83dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:43:52.157679 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf7004-53e4-4b70-925f-2998373e83dd admin admin] PATH_INFO: `/v3/projects/e5d257e1ebb043caaf67249e1c0bb6a5` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:43:52.158852 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf7004-53e4-4b70-925f-2998373e83dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d257e1ebb043caaf67249e1c0bb6a5)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:43:52.160772 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf7004-53e4-4b70-925f-2998373e83dd admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:43:52.207959 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-6aaf7004-53e4-4b70-925f-2998373e83dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d257e1ebb043caaf67249e1c0bb6a5', 'request_id': 'req-6aaf7004-53e4-4b70-925f-2998373e83dd'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:52.213353 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-6aaf7004-53e4-4b70-925f-2998373e83dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d257e1ebb043caaf67249e1c0bb6a5', 'request_id': 'req-6aaf7004-53e4-4b70-925f-2998373e83dd'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:52.219538 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-6aaf7004-53e4-4b70-925f-2998373e83dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d257e1ebb043caaf67249e1c0bb6a5', 'request_id': 'req-6aaf7004-53e4-4b70-925f-2998373e83dd'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:52.232000 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-6aaf7004-53e4-4b70-925f-2998373e83dd admin admin] The token cache is being invalidate because project e5d257e1ebb043caaf67249e1c0bb6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 16:43:52.232321 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-6aaf7004-53e4-4b70-925f-2998373e83dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:52.232970 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-6aaf7004-53e4-4b70-925f-2998373e83dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:52.234487 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 620/1248] 10.222.0.86 () {58 vars in 1232 bytes} [Fri Jul 15 16:43:52 2022] DELETE /identity/v3/projects/e5d257e1ebb043caaf67249e1c0bb6a5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:43:52.238534 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e160df5-be69-462b-a8f7-a40ce9b031a7 admin admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:43:52.239993 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-5e160df5-be69-462b-a8f7-a40ce9b031a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:43:52.253252 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e160df5-be69-462b-a8f7-a40ce9b031a7 admin admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:43:52.277698 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:43:52.311359 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7e4ef-8482-4640-9134-dfbf379a9a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:43:52.312224 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7e4ef-8482-4640-9134-dfbf379a9a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:43:52.312507 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7e4ef-8482-4640-9134-dfbf379a9a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:43:52.312780 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7e4ef-8482-4640-9134-dfbf379a9a1f admin admin] PATH_INFO: `/v3/users/77459639497f48d8b8a17cc8c0f57003` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:43:52.313946 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7e4ef-8482-4640-9134-dfbf379a9a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=77459639497f48d8b8a17cc8c0f57003)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:43:52.315888 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7e4ef-8482-4640-9134-dfbf379a9a1f admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:43:52.360761 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-c8e7e4ef-8482-4640-9134-dfbf379a9a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77459639497f48d8b8a17cc8c0f57003'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:52.367651 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-c8e7e4ef-8482-4640-9134-dfbf379a9a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77459639497f48d8b8a17cc8c0f57003'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:52.368260 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-c8e7e4ef-8482-4640-9134-dfbf379a9a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77459639497f48d8b8a17cc8c0f57003'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:52.380219 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-c8e7e4ef-8482-4640-9134-dfbf379a9a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77459639497f48d8b8a17cc8c0f57003'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:52.386826 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-c8e7e4ef-8482-4640-9134-dfbf379a9a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77459639497f48d8b8a17cc8c0f57003'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:52.392516 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 629/1249] 10.222.0.86 () {58 vars in 1223 bytes} [Fri Jul 15 16:43:52 2022] DELETE /identity/v3/users/77459639497f48d8b8a17cc8c0f57003 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:43:52.572959 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf7004-53e4-4b70-925f-2998373e83dd admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:43:52.574453 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-6aaf7004-53e4-4b70-925f-2998373e83dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:43:52.587669 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf7004-53e4-4b70-925f-2998373e83dd admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:43:52.644177 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:43:52.644960 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:43:52.645349 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:43:52.645629 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f admin admin] PATH_INFO: `/v3/projects/75e5dc2692744bd1b76a11273f581f48` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:43:52.646816 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e5dc2692744bd1b76a11273f581f48)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:43:52.648762 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:43:52.669823 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:43:52.697328 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e5dc2692744bd1b76a11273f581f48', 'request_id': 'req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:52.702697 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e5dc2692744bd1b76a11273f581f48', 'request_id': 'req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:52.708710 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e5dc2692744bd1b76a11273f581f48', 'request_id': 'req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:52.721999 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f admin admin] The token cache is being invalidate because project 75e5dc2692744bd1b76a11273f581f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 16:43:52.722307 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:52.722969 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:43:52.724573 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 621/1250] 10.222.0.86 () {58 vars in 1232 bytes} [Fri Jul 15 16:43:52 2022] DELETE /identity/v3/projects/75e5dc2692744bd1b76a11273f581f48 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:44:02.389232 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:44:02.717952 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:44:10.861142 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579395de-72e1-44d4-8bbc-adda33205d3b None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:44:10.861625 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579395de-72e1-44d4-8bbc-adda33205d3b None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:44:10.861718 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579395de-72e1-44d4-8bbc-adda33205d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:44:10.879520 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-579395de-72e1-44d4-8bbc-adda33205d3b None None] MFA Rules not processed for user `64a282a6605841719be67d7f6d2f90e0`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:44:10.880718 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-579395de-72e1-44d4-8bbc-adda33205d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:44:10.934573 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 630/1251] 10.222.0.86 () {58 vars in 957 bytes} [Fri Jul 15 16:44:10 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:44:20.927681 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=25 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:44:22.597483 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:44:22.598928 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:44:22.654627 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdfc20-2f4b-4cbe-a64d-de03c53e803f admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:44:22.658234 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e4235-2409-403d-9f8e-d063206e0f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:44:22.658887 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e4235-2409-403d-9f8e-d063206e0f85 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:44:22.659197 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e4235-2409-403d-9f8e-d063206e0f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:44:22.659481 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e4235-2409-403d-9f8e-d063206e0f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:44:22.661250 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-892e4235-2409-403d-9f8e-d063206e0f85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:44:22.732139 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e4235-2409-403d-9f8e-d063206e0f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:44:22.733569 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e4235-2409-403d-9f8e-d063206e0f85 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:44:22.744125 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 622/1252] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:44:22 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:44:32.739288 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=50 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:44:57.338569 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579395de-72e1-44d4-8bbc-adda33205d3b None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:44:57.339987 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-579395de-72e1-44d4-8bbc-adda33205d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:44:57.457585 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579395de-72e1-44d4-8bbc-adda33205d3b None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:44:57.462560 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b1c25-5e64-4ee1-a4a0-154b75afc657 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f716b4b39b3d4547ab937f5a5ffccf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:44:57.463233 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b1c25-5e64-4ee1-a4a0-154b75afc657 service placement] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:44:57.463520 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b1c25-5e64-4ee1-a4a0-154b75afc657 service placement] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:44:57.463807 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b1c25-5e64-4ee1-a4a0-154b75afc657 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:44:57.465584 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-ad2b1c25-5e64-4ee1-a4a0-154b75afc657 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:44:57.477083 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b1c25-5e64-4ee1-a4a0-154b75afc657 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:44:57.478653 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b1c25-5e64-4ee1-a4a0-154b75afc657 service placement] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:44:57.488691 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 631/1253] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:44:57 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:45:07.484150 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=54 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:46:40.696240 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e4235-2409-403d-9f8e-d063206e0f85 service neutron] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:46:40.697624 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-892e4235-2409-403d-9f8e-d063206e0f85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:46:40.791303 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e4235-2409-403d-9f8e-d063206e0f85 service neutron] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:46:40.794896 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bbac8-3cff-468c-b5fe-8965c93c64ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a101281ae1f2474886c1ec214f042d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:46:40.795526 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bbac8-3cff-468c-b5fe-8965c93c64ae service cinder] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:46:40.795809 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bbac8-3cff-468c-b5fe-8965c93c64ae service cinder] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:46:40.796085 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bbac8-3cff-468c-b5fe-8965c93c64ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:46:40.797821 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-aa1bbac8-3cff-468c-b5fe-8965c93c64ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:46:40.830343 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bbac8-3cff-468c-b5fe-8965c93c64ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:46:40.831870 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bbac8-3cff-468c-b5fe-8965c93c64ae service cinder] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:46:40.848935 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 623/1254] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:46:40 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:46:50.846363 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=57 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:46:54.985622 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b1c25-5e64-4ee1-a4a0-154b75afc657 service placement] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:46:54.987335 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-ad2b1c25-5e64-4ee1-a4a0-154b75afc657 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:46:55.080026 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b1c25-5e64-4ee1-a4a0-154b75afc657 service placement] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:46:55.085465 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32144f5e-f74c-4b05-a2ea-07d7abae56be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34916bd4d56411e8994d1c476885e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:46:55.086056 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32144f5e-f74c-4b05-a2ea-07d7abae56be service nova] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:46:55.086375 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32144f5e-f74c-4b05-a2ea-07d7abae56be service nova] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:46:55.086674 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32144f5e-f74c-4b05-a2ea-07d7abae56be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:46:55.088503 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-32144f5e-f74c-4b05-a2ea-07d7abae56be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:46:55.100850 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32144f5e-f74c-4b05-a2ea-07d7abae56be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:46:55.102472 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32144f5e-f74c-4b05-a2ea-07d7abae56be service nova] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:46:55.113239 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 632/1255] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:46:54 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 16:46:55.164923 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bbac8-3cff-468c-b5fe-8965c93c64ae service cinder] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:46:55.166339 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-aa1bbac8-3cff-468c-b5fe-8965c93c64ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:46:55.190435 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bbac8-3cff-468c-b5fe-8965c93c64ae service cinder] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:46:55.193975 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af7f2b-a0fb-4e3f-b555-f484c0e509b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:46:55.194671 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af7f2b-a0fb-4e3f-b555-f484c0e509b9 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:46:55.194991 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af7f2b-a0fb-4e3f-b555-f484c0e509b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:46:55.195270 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af7f2b-a0fb-4e3f-b555-f484c0e509b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:46:55.197022 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-a6af7f2b-a0fb-4e3f-b555-f484c0e509b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:46:55.210110 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af7f2b-a0fb-4e3f-b555-f484c0e509b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:46:55.211606 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af7f2b-a0fb-4e3f-b555-f484c0e509b9 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:46:55.221603 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 624/1256] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:46:55 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:46:56.287264 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32144f5e-f74c-4b05-a2ea-07d7abae56be service nova] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:46:56.296267 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32144f5e-f74c-4b05-a2ea-07d7abae56be service nova] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:46:56.299825 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f8ae7-b7e2-42eb-b35b-311f3ae31a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:46:56.300454 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f8ae7-b7e2-42eb-b35b-311f3ae31a8e service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:46:56.300733 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f8ae7-b7e2-42eb-b35b-311f3ae31a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:46:56.301006 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f8ae7-b7e2-42eb-b35b-311f3ae31a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:46:56.302730 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-3d2f8ae7-b7e2-42eb-b35b-311f3ae31a8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:46:56.312005 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f8ae7-b7e2-42eb-b35b-311f3ae31a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:46:56.313399 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f8ae7-b7e2-42eb-b35b-311f3ae31a8e service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:46:56.320989 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 633/1257] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:46:56 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:46:56.395142 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af7f2b-a0fb-4e3f-b555-f484c0e509b9 service neutron] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:46:56.403859 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af7f2b-a0fb-4e3f-b555-f484c0e509b9 service neutron] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:46:56.407399 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f3d43-4e0f-4c43-a419-ab95dc2eb243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:46:56.408031 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3d43-4e0f-4c43-a419-ab95dc2eb243 service neutron] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:46:56.408311 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3d43-4e0f-4c43-a419-ab95dc2eb243 service neutron] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:46:56.408587 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3d43-4e0f-4c43-a419-ab95dc2eb243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:46:56.410336 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-dd3f3d43-4e0f-4c43-a419-ab95dc2eb243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:46:56.422258 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f3d43-4e0f-4c43-a419-ab95dc2eb243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:46:56.423698 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f3d43-4e0f-4c43-a419-ab95dc2eb243 service neutron] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:46:56.433888 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 625/1258] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:46:56 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:47:00.542328 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f8ae7-b7e2-42eb-b35b-311f3ae31a8e service neutron] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:47:00.550833 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f8ae7-b7e2-42eb-b35b-311f3ae31a8e service neutron] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:47:00.554648 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691874fa-9286-469e-af3e-e385c2d7e50b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e620f2a895241279b63327d6a7d3dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:47:00.555318 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691874fa-9286-469e-af3e-e385c2d7e50b service neutron] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:47:00.555601 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691874fa-9286-469e-af3e-e385c2d7e50b service neutron] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:47:00.555877 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691874fa-9286-469e-af3e-e385c2d7e50b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:47:00.557722 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-691874fa-9286-469e-af3e-e385c2d7e50b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:47:00.640576 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691874fa-9286-469e-af3e-e385c2d7e50b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:47:00.641914 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691874fa-9286-469e-af3e-e385c2d7e50b service neutron] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:47:00.651328 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 634/1259] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:47:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 16:47:06.419413 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28058421-0a7b-45f5-a744-970c56732a40 None None] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:47:06.419917 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28058421-0a7b-45f5-a744-970c56732a40 None None] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:47:06.420183 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28058421-0a7b-45f5-a744-970c56732a40 None None] PATH_INFO: `/` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:47:06.421724 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 626/1260] 10.222.0.86 () {54 vars in 921 bytes} [Fri Jul 15 16:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 16:47:06.429101 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=17 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:47:06.456052 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec86f0-ccbe-4010-b61e-400eedf91b0b None None] REQUEST_METHOD: `POST` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:47:06.456502 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec86f0-ccbe-4010-b61e-400eedf91b0b None None] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:47:06.456650 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec86f0-ccbe-4010-b61e-400eedf91b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:47:06.488694 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28058421-0a7b-45f5-a744-970c56732a40 None None] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:47:06.491017 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-28058421-0a7b-45f5-a744-970c56732a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:47:06.492521 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.auth.core [None req-e8ec86f0-ccbe-4010-b61e-400eedf91b0b None None] MFA Rules not processed for user `f716b4b39b3d4547ab937f5a5ffccf08`. Rule list: `[]` (Enabled: `True`). {{(pid=87099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 16:47:06.493869 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-e8ec86f0-ccbe-4010-b61e-400eedf91b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:47:06.504786 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 635/1261] 10.222.0.86 () {58 vars in 1018 bytes} [Fri Jul 15 16:47:06 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 16:47:06.509442 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28058421-0a7b-45f5-a744-970c56732a40 None None] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:47:06.516119 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbcf5f-797f-4173-b0e9-0a184c9de19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:47:06.517133 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbcf5f-797f-4173-b0e9-0a184c9de19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:47:06.517302 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec86f0-ccbe-4010-b61e-400eedf91b0b None None] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:47:06.517611 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbcf5f-797f-4173-b0e9-0a184c9de19f admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:47:06.517990 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbcf5f-797f-4173-b0e9-0a184c9de19f admin admin] PATH_INFO: `/v3/users/64a282a6605841719be67d7f6d2f90e0` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:47:06.519257 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-e8ec86f0-ccbe-4010-b61e-400eedf91b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:47:06.519514 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbcf5f-797f-4173-b0e9-0a184c9de19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=64a282a6605841719be67d7f6d2f90e0)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:47:06.521497 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: WARNING py.warnings [None req-06fbcf5f-797f-4173-b0e9-0a184c9de19f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 16:47:06.521497 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: warnings.warn(msg) Jul 15 16:47:06.521497 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: Jul 15 16:47:06.526438 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbcf5f-797f-4173-b0e9-0a184c9de19f admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:47:06.532794 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec86f0-ccbe-4010-b61e-400eedf91b0b None None] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:47:06.538110 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e07df6-0fcb-4772-af70-6fd006616a39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f716b4b39b3d4547ab937f5a5ffccf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:47:06.539000 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e07df6-0fcb-4772-af70-6fd006616a39 service placement] REQUEST_METHOD: `GET` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:47:06.539285 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e07df6-0fcb-4772-af70-6fd006616a39 service placement] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:47:06.539570 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e07df6-0fcb-4772-af70-6fd006616a39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:47:06.549333 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e07df6-0fcb-4772-af70-6fd006616a39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:47:06.551277 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e07df6-0fcb-4772-af70-6fd006616a39 service placement] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:47:06.562799 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 636/1262] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:47:06 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 16:47:06.603707 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-06fbcf5f-797f-4173-b0e9-0a184c9de19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64a282a6605841719be67d7f6d2f90e0'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:06.614969 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-06fbcf5f-797f-4173-b0e9-0a184c9de19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64a282a6605841719be67d7f6d2f90e0'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:06.615638 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-06fbcf5f-797f-4173-b0e9-0a184c9de19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64a282a6605841719be67d7f6d2f90e0'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:06.634319 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-06fbcf5f-797f-4173-b0e9-0a184c9de19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64a282a6605841719be67d7f6d2f90e0'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:06.644549 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-06fbcf5f-797f-4173-b0e9-0a184c9de19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64a282a6605841719be67d7f6d2f90e0'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:06.650450 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 627/1263] 10.222.0.86 () {58 vars in 1223 bytes} [Fri Jul 15 16:47:06 2022] DELETE /identity/v3/users/64a282a6605841719be67d7f6d2f90e0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:47:06.824959 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e07df6-0fcb-4772-af70-6fd006616a39 service placement] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:47:06.837386 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e07df6-0fcb-4772-af70-6fd006616a39 service placement] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:47:06.845322 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=100 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:47:06.895230 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:47:06.896096 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:47:06.896380 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:47:06.896657 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] PATH_INFO: `/v3/projects/da150b61a1ac422f81a915d352b26c0b` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:47:06.897821 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da150b61a1ac422f81a915d352b26c0b)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:47:06.898828 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: WARNING py.warnings [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 16:47:06.898828 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: warnings.warn(msg) Jul 15 16:47:06.898828 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: Jul 15 16:47:06.900154 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:47:06.954559 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da150b61a1ac422f81a915d352b26c0b', 'request_id': 'req-3f2cfe2f-963e-4b69-8aea-978516707ab2'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:06.960576 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da150b61a1ac422f81a915d352b26c0b', 'request_id': 'req-3f2cfe2f-963e-4b69-8aea-978516707ab2'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:06.973235 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da150b61a1ac422f81a915d352b26c0b', 'request_id': 'req-3f2cfe2f-963e-4b69-8aea-978516707ab2'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:06.985819 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] The token cache is being invalidate because project da150b61a1ac422f81a915d352b26c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 16:47:06.986269 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:06.986940 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:06.988534 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 637/1264] 10.222.0.86 () {58 vars in 1232 bytes} [Fri Jul 15 16:47:06 2022] DELETE /identity/v3/projects/da150b61a1ac422f81a915d352b26c0b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:47:06.992582 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbcf5f-797f-4173-b0e9-0a184c9de19f admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:47:06.994016 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-06fbcf5f-797f-4173-b0e9-0a184c9de19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:47:07.007402 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbcf5f-797f-4173-b0e9-0a184c9de19f admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:47:07.064333 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d13a63-89b9-4350-ae09-2b2caed82da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:47:07.065281 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d13a63-89b9-4350-ae09-2b2caed82da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:47:07.065569 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d13a63-89b9-4350-ae09-2b2caed82da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:47:07.065847 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d13a63-89b9-4350-ae09-2b2caed82da0 admin admin] PATH_INFO: `/v3/users/c12192569cc1477e917dee9c6d92f207` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:47:07.079378 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d13a63-89b9-4350-ae09-2b2caed82da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c12192569cc1477e917dee9c6d92f207)` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:47:07.081751 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d13a63-89b9-4350-ae09-2b2caed82da0 admin admin] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:47:07.127095 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-00d13a63-89b9-4350-ae09-2b2caed82da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c12192569cc1477e917dee9c6d92f207'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:07.134000 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-00d13a63-89b9-4350-ae09-2b2caed82da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c12192569cc1477e917dee9c6d92f207'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:07.134621 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-00d13a63-89b9-4350-ae09-2b2caed82da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c12192569cc1477e917dee9c6d92f207'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:07.142173 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:47:07.149591 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-00d13a63-89b9-4350-ae09-2b2caed82da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c12192569cc1477e917dee9c6d92f207'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:07.156740 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.notifications [None req-00d13a63-89b9-4350-ae09-2b2caed82da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c12192569cc1477e917dee9c6d92f207'} {{(pid=87100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:07.162531 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 628/1265] 10.222.0.86 () {58 vars in 1223 bytes} [Fri Jul 15 16:47:06 2022] DELETE /identity/v3/users/c12192569cc1477e917dee9c6d92f207 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:47:07.334802 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] Authenticating user token {{(pid=87099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:47:07.336300 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.fernet_utils [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:47:07.351359 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cfe2f-963e-4b69-8aea-978516707ab2 admin admin] Validating token access rules against request {{(pid=87099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:47:07.409036 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef49dc7-23e7-4f8b-9ec1-cb534eea9810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44293b77272f4265bf2e4dd85cca6be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcb5a6ba5f5c46348953f622f9e98380', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:47:07.409906 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef49dc7-23e7-4f8b-9ec1-cb534eea9810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:47:07.410215 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef49dc7-23e7-4f8b-9ec1-cb534eea9810 admin admin] SCRIPT_NAME: `/identity` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:47:07.410497 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef49dc7-23e7-4f8b-9ec1-cb534eea9810 admin admin] PATH_INFO: `/v3/projects/f30f88d8dbc040f09eb29f264060eda9` {{(pid=87099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:47:07.421311 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef49dc7-23e7-4f8b-9ec1-cb534eea9810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30f88d8dbc040f09eb29f264060eda9)` {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:47:07.423271 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef49dc7-23e7-4f8b-9ec1-cb534eea9810 admin admin] RBAC: Authorization granted {{(pid=87099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:47:07.459985 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:47:07.470987 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-7ef49dc7-23e7-4f8b-9ec1-cb534eea9810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30f88d8dbc040f09eb29f264060eda9', 'request_id': 'req-7ef49dc7-23e7-4f8b-9ec1-cb534eea9810'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:07.476314 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-7ef49dc7-23e7-4f8b-9ec1-cb534eea9810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30f88d8dbc040f09eb29f264060eda9', 'request_id': 'req-7ef49dc7-23e7-4f8b-9ec1-cb534eea9810'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:07.483170 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-7ef49dc7-23e7-4f8b-9ec1-cb534eea9810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30f88d8dbc040f09eb29f264060eda9', 'request_id': 'req-7ef49dc7-23e7-4f8b-9ec1-cb534eea9810'} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:07.495470 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-7ef49dc7-23e7-4f8b-9ec1-cb534eea9810 admin admin] The token cache is being invalidate because project f30f88d8dbc040f09eb29f264060eda9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 16:47:07.495760 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-7ef49dc7-23e7-4f8b-9ec1-cb534eea9810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:07.496399 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG keystone.notifications [None req-7ef49dc7-23e7-4f8b-9ec1-cb534eea9810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 16:47:07.498518 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: [pid: 87099|app: 0|req: 638/1266] 10.222.0.86 () {58 vars in 1232 bytes} [Fri Jul 15 16:47:07 2022] DELETE /identity/v3/projects/f30f88d8dbc040f09eb29f264060eda9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 16:47:17.159129 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=8,keystone:DELETE=1 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:47:17.492432 dv-osbrick-836059-6-ceph devstack@keystone.service[87099]: DEBUG dbcounter [-] [87099] Writing DB stats keystone:DELETE=5,keystone:SELECT=11,keystone:INSERT=1 {{(pid=87099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 16:50:01.253746 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d13a63-89b9-4350-ae09-2b2caed82da0 admin admin] Authenticating user token {{(pid=87100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 16:50:01.255174 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-00d13a63-89b9-4350-ae09-2b2caed82da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:50:01.332331 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d13a63-89b9-4350-ae09-2b2caed82da0 admin admin] Validating token access rules against request {{(pid=87100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 16:50:01.389418 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3da592-ebc9-4575-bcd0-80772e1d2ff6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f716b4b39b3d4547ab937f5a5ffccf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db599cc43051468cbf306faba2431b23', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 16:50:01.390062 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3da592-ebc9-4575-bcd0-80772e1d2ff6 service placement] REQUEST_METHOD: `GET` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 16:50:01.390347 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3da592-ebc9-4575-bcd0-80772e1d2ff6 service placement] SCRIPT_NAME: `/identity` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 16:50:01.390626 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3da592-ebc9-4575-bcd0-80772e1d2ff6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 16:50:01.392463 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.fernet_utils [None req-fe3da592-ebc9-4575-bcd0-80772e1d2ff6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 16:50:01.403260 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3da592-ebc9-4575-bcd0-80772e1d2ff6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 16:50:01.404869 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3da592-ebc9-4575-bcd0-80772e1d2ff6 service placement] RBAC: Authorization granted {{(pid=87100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 16:50:01.414304 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: [pid: 87100|app: 0|req: 629/1267] 10.222.0.86 () {60 vars in 1365 bytes} [Fri Jul 15 16:50:01 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 16:50:11.410387 dv-osbrick-836059-6-ceph devstack@keystone.service[87100]: DEBUG dbcounter [-] [87100] Writing DB stats keystone:SELECT=62 {{(pid=87100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}